Nov 27 04:34:30 user nova-compute[75260]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75260) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 27 04:34:30 user nova-compute[75260]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75260) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 27 04:34:30 user nova-compute[75260]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75260) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 27 04:34:30 user nova-compute[75260]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 27 04:34:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:34:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:34:30 user nova-compute[75260]: INFO nova.virt.driver [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 27 04:34:31 user nova-compute[75260]: INFO nova.compute.provider_config [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] Acquiring lock "singleton_lock" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] Acquired lock "singleton_lock" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] Releasing lock "singleton_lock" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] Full set of CONF: {{(pid=75260) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ******************************************************************************** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] Configuration options gathered from: {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ================================================================================ {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] allow_resize_to_same_host      = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] arq_binding_timeout            = 300 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] backdoor_port                  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] backdoor_socket                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] block_device_allocate_retries  = 300 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] block_device_allocate_retries_interval = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cert                           = self.pem {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute_monitors               = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] config_dir                     = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] config_drive_format            = iso9660 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] config_source                  = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] console_host                   = user {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] control_exchange               = nova {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cpu_allocation_ratio           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] daemon                         = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] debug                          = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] default_access_ip_network_name = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] default_availability_zone      = nova {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] default_ephemeral_format       = ext4 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] default_green_pool_size        = 1000 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] default_schedule_zone          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] disk_allocation_ratio          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] enable_new_services            = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] enabled_apis                   = ['osapi_compute'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] enabled_ssl_apis               = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] flat_injected                  = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] force_config_drive             = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] force_raw_images               = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] graceful_shutdown_timeout      = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] heal_instance_info_cache_interval = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] host                           = user {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] instance_build_timeout         = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] instance_delete_interval       = 300 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] instance_format                = [instance: %(uuid)s]  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] instance_name_template         = instance-%08x {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] instance_usage_audit           = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] instance_usage_audit_period    = month {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] internal_service_availability_zone = internal {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] key                            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] live_migration_retry_count     = 30 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] log_config_append              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] log_dir                        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] log_file                       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] log_options                    = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] log_rotate_interval            = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] log_rotate_interval_type       = days {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] log_rotation_type              = none {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] long_rpc_timeout               = 1800 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] max_concurrent_builds          = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] max_concurrent_live_migrations = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] max_concurrent_snapshots       = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] max_local_block_devices        = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] max_logfile_count              = 30 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] max_logfile_size_mb            = 200 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] maximum_instance_delete_attempts = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] metadata_listen                = 0.0.0.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] metadata_listen_port           = 8775 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] metadata_workers               = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] migrate_max_retries            = -1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] mkisofs_cmd                    = genisoimage {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] my_ip                          = 10.0.0.210 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] network_allocate_retries       = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] osapi_compute_listen_port      = 8774 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] osapi_compute_unique_server_name_scope =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] osapi_compute_workers          = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] password_length                = 12 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] periodic_enable                = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] periodic_fuzzy_delay           = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] pointer_model                  = ps2mouse {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] preallocate_images             = none {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] publish_errors                 = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] pybasedir                      = /opt/stack/nova {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ram_allocation_ratio           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] rate_limit_burst               = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] rate_limit_except_level        = CRITICAL {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] rate_limit_interval            = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] reboot_timeout                 = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] reclaim_instance_interval      = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] record                         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] reimage_timeout_per_gb         = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] report_interval                = 120 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] rescue_timeout                 = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] reserved_host_cpus             = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] reserved_host_disk_mb          = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] reserved_host_memory_mb        = 512 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] reserved_huge_pages            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] resize_confirm_window          = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] resize_fs_using_block_device   = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] resume_guests_state_on_host_boot = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] rpc_response_timeout           = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] run_external_periodic_tasks    = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] running_deleted_instance_action = reap {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] running_deleted_instance_poll_interval = 1800 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] running_deleted_instance_timeout = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler_instance_sync_interval = 120 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_down_time              = 720 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] servicegroup_driver            = db {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] shelved_offload_time           = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] shelved_poll_interval          = 3600 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] shutdown_timeout               = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] source_is_ipv6                 = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ssl_only                       = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] state_path                     = /opt/stack/data/nova {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] sync_power_state_interval      = 600 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] sync_power_state_pool_size     = 1000 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] syslog_log_facility            = LOG_USER {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] tempdir                        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] timeout_nbd                    = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] transport_url                  = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] update_resources_interval      = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] use_cow_images                 = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] use_eventlog                   = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] use_journal                    = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] use_json                       = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] use_rootwrap_daemon            = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] use_stderr                     = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] use_syslog                     = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vcpu_pin_set                   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plugging_is_fatal          = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plugging_timeout           = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] virt_mkfs                      = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] volume_usage_poll_interval     = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] watch_log_file                 = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] web                            = /usr/share/spice-html5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_concurrency.disable_process_locking = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.auth_strategy              = keystone {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.compute_link_prefix        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.dhcp_domain                = novalocal {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.enable_instance_password   = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.glance_link_prefix         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.instance_list_per_project_cells = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.list_records_by_skipping_down_cells = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.local_metadata_per_cell    = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.max_limit                  = 1000 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.metadata_cache_expiration  = 15 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.neutron_default_tenant_id  = default {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.use_forwarded_for          = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.use_neutron_default_nets   = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.vendordata_dynamic_targets = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.vendordata_jsonfile_path   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.backend                  = dogpile.cache.memcached {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.backend_argument         = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.config_prefix            = cache.oslo {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.dead_timeout             = 60.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.debug_cache_backend      = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.enable_retry_client      = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.enable_socket_keepalive  = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.enabled                  = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.expiration_time          = 600 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.hashclient_retry_attempts = 2 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.memcache_dead_retry      = 300 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.memcache_password        =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.memcache_pool_maxsize    = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.memcache_sasl_enabled    = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.memcache_username        =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.proxies                  = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.retry_attempts           = 2 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.retry_delay              = 0.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.socket_keepalive_count   = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.socket_keepalive_idle    = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.socket_keepalive_interval = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.tls_allowed_ciphers      = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.tls_cafile               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.tls_certfile             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.tls_enabled              = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cache.tls_keyfile              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.auth_section            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.auth_type               = password {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.cafile                  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.certfile                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.collect_timing          = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.cross_az_attach         = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.debug                   = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.endpoint_template       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.http_retries            = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.insecure                = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.keyfile                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.os_region_name          = RegionOne {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.split_loggers           = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cinder.timeout                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.cpu_dedicated_set      = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.cpu_shared_set         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.image_type_exclude_list = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.max_concurrent_disk_ops = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.max_disk_devices_to_attach = -1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.resource_provider_association_refresh = 300 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.shutdown_retry_interval = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] conductor.workers              = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] console.allowed_origins        = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] console.ssl_ciphers            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] console.ssl_minimum_version    = default {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] consoleauth.token_ttl          = 600 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.cafile                  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.certfile                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.collect_timing          = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.connect_retries         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.connect_retry_delay     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.endpoint_override       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.insecure                = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.keyfile                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.max_version             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.min_version             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.region_name             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.service_name            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.service_type            = accelerator {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.split_loggers           = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.status_code_retries     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.status_code_retry_delay = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.timeout                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] cyborg.version                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.backend               = sqlalchemy {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.connection            = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.connection_debug      = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.connection_parameters =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.connection_recycle_time = 3600 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.connection_trace      = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.db_inc_retry_interval = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.db_max_retries        = 20 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.db_max_retry_interval = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.db_retry_interval     = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.max_overflow          = 50 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.max_pool_size         = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.max_retries           = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.mysql_wsrep_sync_wait = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.pool_timeout          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.retry_interval        = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.slave_connection      = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] database.sqlite_synchronous    = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.backend           = sqlalchemy {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.connection        = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.connection_debug  = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.connection_parameters =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.connection_recycle_time = 3600 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.connection_trace  = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.db_inc_retry_interval = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.db_max_retries    = 20 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.db_max_retry_interval = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.db_retry_interval = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.max_overflow      = 50 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.max_pool_size     = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.max_retries       = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.pool_timeout      = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.retry_interval    = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.slave_connection  = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] api_database.sqlite_synchronous = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] devices.enabled_mdev_types     = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ephemeral_storage_encryption.enabled = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.api_servers             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.cafile                  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.certfile                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.collect_timing          = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.connect_retries         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.connect_retry_delay     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.debug                   = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.default_trusted_certificate_ids = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.enable_certificate_validation = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.enable_rbd_download     = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.endpoint_override       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.insecure                = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.keyfile                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.max_version             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.min_version             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.num_retries             = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.rbd_ceph_conf           =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.rbd_connect_timeout     = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.rbd_pool                =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.rbd_user                =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.region_name             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.service_name            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.service_type            = image {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.split_loggers           = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.status_code_retries     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.status_code_retry_delay = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.timeout                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.verify_glance_signatures = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] glance.version                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] guestfs.debug                  = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.config_drive_cdrom      = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.config_drive_inject_password = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.enable_instance_metrics_collection = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.enable_remotefx         = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.instances_path_share    =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.iscsi_initiator_list    = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.limit_cpu_features      = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.power_state_check_timeframe = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.use_multipath_io        = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.volume_attach_retry_count = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.vswitch_name            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] mks.enabled                    = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] image_cache.manager_interval   = 2400 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] image_cache.precache_concurrency = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] image_cache.remove_unused_base_images = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] image_cache.subdirectory_name  = _base {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.api_max_retries         = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.api_retry_interval      = 2 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.auth_section            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.auth_type               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.cafile                  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.certfile                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.collect_timing          = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.conductor_group         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.connect_retries         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.connect_retry_delay     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.endpoint_override       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.insecure                = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.keyfile                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.max_version             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.min_version             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.peer_list               = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.region_name             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.serial_console_state_timeout = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.service_name            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.service_type            = baremetal {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.split_loggers           = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.status_code_retries     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.status_code_retry_delay = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.timeout                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ironic.version                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] key_manager.fixed_key          = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.barbican_api_version  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.barbican_endpoint     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.barbican_endpoint_type = public {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.barbican_region_name  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.cafile                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.certfile              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.collect_timing        = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.insecure              = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.keyfile               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.number_of_retries     = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.retry_delay           = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.send_service_user_token = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.split_loggers         = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.timeout               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.verify_ssl            = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican.verify_ssl_path       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican_service_user.auth_section = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican_service_user.auth_type = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican_service_user.cafile   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican_service_user.certfile = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican_service_user.collect_timing = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican_service_user.insecure = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican_service_user.keyfile  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican_service_user.split_loggers = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] barbican_service_user.timeout  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.approle_role_id          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.approle_secret_id        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.cafile                   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.certfile                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.collect_timing           = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.insecure                 = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.keyfile                  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.kv_mountpoint            = secret {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.kv_path                  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.kv_version               = 2 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.namespace                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.root_token_id            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.split_loggers            = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.ssl_ca_crt_file          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.timeout                  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.use_ssl                  = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.auth_section          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.auth_type             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.cafile                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.certfile              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.collect_timing        = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.connect_retries       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.connect_retry_delay   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.endpoint_override     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.insecure              = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.keyfile               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.max_version           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.min_version           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.region_name           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.service_name          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.service_type          = identity {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.split_loggers         = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.status_code_retries   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.status_code_retry_delay = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.timeout               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] keystone.version               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.connection_uri         =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.cpu_mode               = custom {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: WARNING oslo_config.cfg [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.cpu_power_governor_high = performance {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.cpu_power_governor_low = powersave {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.cpu_power_management   = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.device_detach_attempts = 8 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.device_detach_timeout  = 20 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.disk_cachemodes        = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.disk_prefix            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.enabled_perf_events    = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.file_backed_memory     = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.gid_maps               = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.hw_disk_discard        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.hw_machine_type        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.images_rbd_glance_store_name =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.images_rbd_pool        = rbd {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.images_type            = default {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.images_volume_group    = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.inject_key             = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.inject_partition       = -2 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.inject_password        = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.iscsi_iface            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.iser_use_multipath     = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_bandwidth = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_downtime = 500 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_inbound_addr = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_permit_post_copy = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_scheme  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_timeout_action = abort {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_tunnelled = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: WARNING oslo_config.cfg [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 27 04:34:31 user nova-compute[75260]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 27 04:34:31 user nova-compute[75260]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 27 04:34:31 user nova-compute[75260]: and ``live_migration_inbound_addr`` respectively.
Nov 27 04:34:31 user nova-compute[75260]: ).  Its value may be silently ignored in the future.
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.live_migration_with_native_tls = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.max_queues             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.nfs_mount_options      = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.num_memory_encrypted_guests = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.num_pcie_ports         = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.pmem_namespaces        = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.quobyte_client_cfg     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.rbd_secret_uuid        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.rbd_user               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.remote_filesystem_transport = ssh {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.rescue_image_id        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.rescue_kernel_id       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.rescue_ramdisk_id      = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.rx_queue_size          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.smbfs_mount_options    =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.snapshot_compression   = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.snapshot_image_format  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.sparse_logical_volumes = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.swtpm_enabled          = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.swtpm_group            = tss {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.swtpm_user             = tss {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.sysinfo_serial         = unique {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.tb_cache_size          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.tx_queue_size          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.uid_maps               = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.use_virtio_for_bridges = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.virt_type              = kvm {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.volume_clear           = zero {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.volume_clear_size      = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.volume_use_multipath   = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.vzstorage_cache_path   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.vzstorage_mount_user   = stack {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.auth_section           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.auth_type              = password {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.cafile                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.certfile               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.collect_timing         = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.connect_retries        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.connect_retry_delay    = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.default_floating_pool  = public {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.endpoint_override      = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.extension_sync_interval = 600 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.http_retries           = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.insecure               = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.keyfile                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.max_version            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.min_version            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.ovs_bridge             = br-int {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.physnets               = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.region_name            = RegionOne {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.service_metadata_proxy = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.service_name           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.service_type           = network {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.split_loggers          = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.status_code_retries    = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.status_code_retry_delay = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.timeout                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] neutron.version                = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] notifications.bdms_in_notifications = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] notifications.default_level    = INFO {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] notifications.notification_format = unversioned {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] notifications.notify_on_state_change = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] pci.alias                      = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] pci.device_spec                = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] pci.report_in_placement        = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.auth_section         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.auth_type            = password {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.cafile               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.certfile             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.collect_timing       = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.connect_retries      = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.connect_retry_delay  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.default_domain_id    = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.default_domain_name  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.domain_id            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.domain_name          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.endpoint_override    = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.insecure             = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.keyfile              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.max_version          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.min_version          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.password             = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.project_domain_id    = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.project_domain_name  = Default {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.project_id           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.project_name         = service {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.region_name          = RegionOne {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.service_name         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.service_type         = placement {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.split_loggers        = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.status_code_retries  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.status_code_retry_delay = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.system_scope         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.timeout              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.trust_id             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.user_domain_id       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.user_domain_name     = Default {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.user_id              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.username             = placement {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] placement.version              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.cores                    = 20 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.count_usage_from_placement = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.injected_file_content_bytes = 10240 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.injected_file_path_length = 255 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.injected_files           = 5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.instances                = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.key_pairs                = 100 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.metadata_items           = 128 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.ram                      = 51200 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.recheck_quota            = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.server_group_members     = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] quota.server_groups            = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] rdp.enabled                    = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler.image_metadata_prefilter = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler.max_attempts         = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler.max_placement_results = 1000 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler.query_placement_for_image_type_support = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] scheduler.workers              = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.host_subset_size = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.isolated_hosts = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.isolated_images = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.pci_in_placement = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.track_instance_changes = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] metrics.required               = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] metrics.weight_multiplier      = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] metrics.weight_setting         = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] serial_console.enabled         = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] serial_console.port_range      = 10000:20000 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] serial_console.serialproxy_port = 6083 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_user.auth_section      = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_user.auth_type         = password {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_user.cafile            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_user.certfile          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_user.collect_timing    = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_user.insecure          = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_user.keyfile           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_user.send_service_user_token = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_user.split_loggers     = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] service_user.timeout           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.agent_enabled            = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.enabled                  = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.html5proxy_port          = 6082 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.image_compression        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.jpeg_compression         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.playback_compression     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.server_listen            = 127.0.0.1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.streaming_mode           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] spice.zlib_compression         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] upgrade_levels.baseapi         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] upgrade_levels.compute         = auto {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] upgrade_levels.conductor       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] upgrade_levels.scheduler       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vendordata_dynamic_auth.auth_section = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vendordata_dynamic_auth.auth_type = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vendordata_dynamic_auth.cafile = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vendordata_dynamic_auth.certfile = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vendordata_dynamic_auth.insecure = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vendordata_dynamic_auth.keyfile = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vendordata_dynamic_auth.timeout = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.api_retry_count         = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.ca_file                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.cache_prefix            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.cluster_name            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.connection_pool_size    = 10 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.console_delay_seconds   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.datastore_regex         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.host_ip                 = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.host_password           = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.host_port               = 443 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.host_username           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.insecure                = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.integration_bridge      = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.maximum_objects         = 100 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.pbm_default_policy      = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.pbm_enabled             = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.pbm_wsdl_location       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.serial_port_proxy_uri   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.serial_port_service_uri = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.task_poll_interval      = 0.5 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.use_linked_clone        = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.vnc_keymap              = en-us {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.vnc_port                = 5900 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vmware.vnc_port_total          = 10000 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vnc.auth_schemes               = ['none'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vnc.enabled                    = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vnc.novncproxy_port            = 6080 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vnc.server_listen              = 0.0.0.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vnc.vencrypt_ca_certs          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vnc.vencrypt_client_cert       = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vnc.vencrypt_client_key        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.disable_rootwrap   = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.enable_numa_live_migration = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.libvirt_disable_apic = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.client_socket_timeout     = 900 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.default_pool_size         = 1000 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.keep_alive                = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.max_header_line           = 16384 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.ssl_ca_file               = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.ssl_cert_file             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.ssl_key_file              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.tcp_keepidle              = 600 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] zvm.ca_file                    = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] zvm.cloud_connector_url        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] zvm.reachable_timeout          = 300 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_policy.enforce_new_defaults = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_policy.enforce_scope      = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_policy.policy_default_rule = default {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_policy.policy_file        = policy.yaml {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.connection_string     = messaging:// {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.enabled               = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.es_doc_type           = notification {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.es_scroll_size        = 10000 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.es_scroll_time        = 2m {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.filter_error_trace    = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.hmac_keys             = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.sentinel_service_name = mymaster {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.socket_timeout        = 0.1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.trace_requests        = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler.trace_sqlalchemy      = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler_jaeger.process_tags   = {} {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler_jaeger.service_name_prefix = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] profiler_otlp.service_name_prefix = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] remote_debug.host              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] remote_debug.port              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.ssl      = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_notifications.retry = -1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.auth_section        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.auth_type           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.cafile              = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.certfile            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.collect_timing      = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.connect_retries     = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.connect_retry_delay = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.endpoint_id         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.endpoint_override   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.insecure            = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.keyfile             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.max_version         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.min_version         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.region_name         = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.service_name        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.service_type        = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.split_loggers       = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.status_code_retries = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.status_code_retry_delay = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.timeout             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.valid_interfaces    = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_limit.version             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_reports.file_event_handler = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] oslo_reports.log_dir           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_ovs_privileged.group  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] vif_plug_ovs_privileged.user   = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_linux_bridge.flat_interface = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_ovs.isolate_vif         = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_vif_ovs.per_port_bridge     = False {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] os_brick.lock_path             = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] privsep_osbrick.capabilities   = [21] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] privsep_osbrick.group          = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] privsep_osbrick.helper_command = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] privsep_osbrick.user           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] nova_sys_admin.group           = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] nova_sys_admin.helper_command  = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] nova_sys_admin.user            = None {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG oslo_service.service [None req-1a69e5d7-87d4-40fc-a6c9-f9640cf0a00b None None] ******************************************************************************** {{(pid=75260) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 27 04:34:31 user nova-compute[75260]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 27 04:34:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Connecting to libvirt: qemu:///system {{(pid=75260) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ffb74d6a920> {{(pid=75260) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 27 04:34:31 user nova-compute[75260]: libvirt:  error : internal error: could not initialize domain event timer
Nov 27 04:34:31 user nova-compute[75260]: WARNING nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 27 04:34:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ffb74d6a920> {{(pid=75260) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Starting native event thread {{(pid=75260) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Starting green dispatch thread {{(pid=75260) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 27 04:34:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Starting connection event dispatch thread {{(pid=75260) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 27 04:34:31 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Connection event '1' reason 'None'
Nov 27 04:34:31 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 27 04:34:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.mount [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Initialising _HostMountState generation 0 {{(pid=75260) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 27 04:34:38 user nova-compute[75260]: INFO nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Libvirt host capabilities <capabilities>
Nov 27 04:34:38 user nova-compute[75260]:   <host>
Nov 27 04:34:38 user nova-compute[75260]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 27 04:34:38 user nova-compute[75260]:     <cpu>
Nov 27 04:34:38 user nova-compute[75260]:       <arch>x86_64</arch>
Nov 27 04:34:38 user nova-compute[75260]:       <model>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <vendor>Intel</vendor>
Nov 27 04:34:38 user nova-compute[75260]:       <microcode version='1070'/>
Nov 27 04:34:38 user nova-compute[75260]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 27 04:34:38 user nova-compute[75260]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='ss'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='vmx'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='pcid'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='osxsave'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='hypervisor'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='arat'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='tsc_adjust'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='md-clear'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='arch-capabilities'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='invtsc'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='rsba'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature name='skip-l1dfl-vmentry'/>
Nov 27 04:34:38 user nova-compute[75260]:       <pages unit='KiB' size='4'/>
Nov 27 04:34:38 user nova-compute[75260]:       <pages unit='KiB' size='2048'/>
Nov 27 04:34:38 user nova-compute[75260]:     </cpu>
Nov 27 04:34:38 user nova-compute[75260]:     <power_management>
Nov 27 04:34:38 user nova-compute[75260]:       <suspend_mem/>
Nov 27 04:34:38 user nova-compute[75260]:       <suspend_disk/>
Nov 27 04:34:38 user nova-compute[75260]:       <suspend_hybrid/>
Nov 27 04:34:38 user nova-compute[75260]:     </power_management>
Nov 27 04:34:38 user nova-compute[75260]:     <iommu support='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     <migration_features>
Nov 27 04:34:38 user nova-compute[75260]:       <live/>
Nov 27 04:34:38 user nova-compute[75260]:       <uri_transports>
Nov 27 04:34:38 user nova-compute[75260]:         <uri_transport>tcp</uri_transport>
Nov 27 04:34:38 user nova-compute[75260]:         <uri_transport>rdma</uri_transport>
Nov 27 04:34:38 user nova-compute[75260]:       </uri_transports>
Nov 27 04:34:38 user nova-compute[75260]:     </migration_features>
Nov 27 04:34:38 user nova-compute[75260]:     <topology>
Nov 27 04:34:38 user nova-compute[75260]:       <cells num='2'>
Nov 27 04:34:38 user nova-compute[75260]:         <cell id='0'>
Nov 27 04:34:38 user nova-compute[75260]:           <memory unit='KiB'>8140616</memory>
Nov 27 04:34:38 user nova-compute[75260]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 27 04:34:38 user nova-compute[75260]:           <pages unit='KiB' size='2048'>0</pages>
Nov 27 04:34:38 user nova-compute[75260]:           <distances>
Nov 27 04:34:38 user nova-compute[75260]:             <sibling id='0' value='10'/>
Nov 27 04:34:38 user nova-compute[75260]:             <sibling id='1' value='20'/>
Nov 27 04:34:38 user nova-compute[75260]:           </distances>
Nov 27 04:34:38 user nova-compute[75260]:           <cpus num='6'>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 27 04:34:38 user nova-compute[75260]:           </cpus>
Nov 27 04:34:38 user nova-compute[75260]:         </cell>
Nov 27 04:34:38 user nova-compute[75260]:         <cell id='1'>
Nov 27 04:34:38 user nova-compute[75260]:           <memory unit='KiB'>8255068</memory>
Nov 27 04:34:38 user nova-compute[75260]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 27 04:34:38 user nova-compute[75260]:           <pages unit='KiB' size='2048'>0</pages>
Nov 27 04:34:38 user nova-compute[75260]:           <distances>
Nov 27 04:34:38 user nova-compute[75260]:             <sibling id='0' value='20'/>
Nov 27 04:34:38 user nova-compute[75260]:             <sibling id='1' value='10'/>
Nov 27 04:34:38 user nova-compute[75260]:           </distances>
Nov 27 04:34:38 user nova-compute[75260]:           <cpus num='6'>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 27 04:34:38 user nova-compute[75260]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 27 04:34:38 user nova-compute[75260]:           </cpus>
Nov 27 04:34:38 user nova-compute[75260]:         </cell>
Nov 27 04:34:38 user nova-compute[75260]:       </cells>
Nov 27 04:34:38 user nova-compute[75260]:     </topology>
Nov 27 04:34:38 user nova-compute[75260]:     <cache>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 27 04:34:38 user nova-compute[75260]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 27 04:34:38 user nova-compute[75260]:     </cache>
Nov 27 04:34:38 user nova-compute[75260]:     <secmodel>
Nov 27 04:34:38 user nova-compute[75260]:       <model>apparmor</model>
Nov 27 04:34:38 user nova-compute[75260]:       <doi>0</doi>
Nov 27 04:34:38 user nova-compute[75260]:     </secmodel>
Nov 27 04:34:38 user nova-compute[75260]:     <secmodel>
Nov 27 04:34:38 user nova-compute[75260]:       <model>dac</model>
Nov 27 04:34:38 user nova-compute[75260]:       <doi>0</doi>
Nov 27 04:34:38 user nova-compute[75260]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 27 04:34:38 user nova-compute[75260]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 27 04:34:38 user nova-compute[75260]:     </secmodel>
Nov 27 04:34:38 user nova-compute[75260]:   </host>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='alpha'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>clipper</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='armv6l'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>integratorcp</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>borzoi</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>spitz</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>nuri</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>musca-b1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>versatileab</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>kzm</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>musca-a</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>smdkc210</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sx1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>z2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>tosa</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>sabrelite</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>realview-eb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>n810</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>n800</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>versatilepb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>terrier</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mainstone</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>midway</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>musicpal</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>microbit</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>cubieboard</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>verdex</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>netduino2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>raspi2b</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>cheetah</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>highbank</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>akita</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>connex</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>collie</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>raspi0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='armv7l'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>integratorcp</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>borzoi</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>spitz</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>nuri</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>musca-b1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>versatileab</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>kzm</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>musca-a</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>smdkc210</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sx1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>z2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>tosa</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>sabrelite</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>realview-eb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>n810</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>n800</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>versatilepb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>terrier</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mainstone</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>midway</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>musicpal</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>microbit</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>cubieboard</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>verdex</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>netduino2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>raspi2b</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>cheetah</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>highbank</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>akita</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>connex</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>collie</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>raspi0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='aarch64'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>integratorcp</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>borzoi</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>spitz</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>nuri</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>musca-b1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>versatileab</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>kzm</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>musca-a</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>smdkc210</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sx1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>z2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>tosa</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>sabrelite</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>realview-eb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>n810</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>n800</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>versatilepb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>terrier</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mainstone</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>midway</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>musicpal</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>microbit</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>cubieboard</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>verdex</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>netduino2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>raspi3b</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>raspi2b</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>cheetah</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>highbank</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>akita</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>connex</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>collie</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>raspi0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <acpi default='on' toggle='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='cris'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='i686'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>x-remote</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>isapc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>microvm</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='kvm'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <pae/>
Nov 27 04:34:38 user nova-compute[75260]:       <nonpae/>
Nov 27 04:34:38 user nova-compute[75260]:       <acpi default='on' toggle='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:       <apic default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='m68k'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>an5206</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>q800</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>next-cube</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='microblaze'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='microblazeel'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='mips'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='16'>malta</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='mipsel'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='16'>malta</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='mips64'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='16'>malta</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>pica61</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>magnum</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='mips64el'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='16'>malta</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>pica61</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>magnum</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='16'>boston</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='ppc'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>g3beige</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mac99</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>ppce500</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>pegasos2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sam460ex</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>bamboo</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>40p</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>ref405ep</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>taihu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='ppc64'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2048'>powernv9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>taihu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2048'>powernv10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>ppce500</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>40p</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>pegasos2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>bamboo</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>g3beige</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mac99</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sam460ex</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>ref405ep</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2048'>powernv8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='ppc64le'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2048'>powernv9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>taihu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2048'>powernv10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>ppce500</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>40p</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>pegasos2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>bamboo</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>g3beige</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>mac99</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sam460ex</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>ref405ep</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2048'>powernv8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='riscv32'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='8'>spike</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>opentitan</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='5'>sifive_u</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sifive_e</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='8'>virt</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='riscv64'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='8'>spike</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='5'>sifive_u</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>shakti_c</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sifive_e</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='8'>virt</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='s390x'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='sh4'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>shix</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>r2d</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='sh4eb'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>shix</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>r2d</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='sparc'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>SS-5</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>SS-20</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>LX</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>SS-4</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>SS-10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>Voyager</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='sparc64'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sun4u</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>niagara</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>sun4v</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='x86_64'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>64</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>x-remote</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='1'>isapc</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>microvm</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='kvm'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <acpi default='on' toggle='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:       <apic default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='xtensa'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>sim</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>kc705</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>ml605</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>virt</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>lx200</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>lx60</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]:   <guest>
Nov 27 04:34:38 user nova-compute[75260]:     <os_type>hvm</os_type>
Nov 27 04:34:38 user nova-compute[75260]:     <arch name='xtensaeb'>
Nov 27 04:34:38 user nova-compute[75260]:       <wordsize>32</wordsize>
Nov 27 04:34:38 user nova-compute[75260]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='4'>sim</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>kc705</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>ml605</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>virt</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>lx200</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>lx60</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 27 04:34:38 user nova-compute[75260]:       <domain type='qemu'/>
Nov 27 04:34:38 user nova-compute[75260]:     </arch>
Nov 27 04:34:38 user nova-compute[75260]:     <features>
Nov 27 04:34:38 user nova-compute[75260]:       <cpuselection/>
Nov 27 04:34:38 user nova-compute[75260]:       <deviceboot/>
Nov 27 04:34:38 user nova-compute[75260]:       <disksnapshot default='on' toggle='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     </features>
Nov 27 04:34:38 user nova-compute[75260]:   </guest>
Nov 27 04:34:38 user nova-compute[75260]: </capabilities>
Nov 27 04:34:38 user nova-compute[75260]: 
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 27 04:34:38 user nova-compute[75260]: <domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 04:34:38 user nova-compute[75260]:   <domain>kvm</domain>
Nov 27 04:34:38 user nova-compute[75260]:   <machine>pc-q35-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:   <arch>i686</arch>
Nov 27 04:34:38 user nova-compute[75260]:   <vcpu max='288'/>
Nov 27 04:34:38 user nova-compute[75260]:   <iothreads supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:   <os supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='firmware'/>
Nov 27 04:34:38 user nova-compute[75260]:     <loader supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>rom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pflash</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='readonly'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>yes</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='secure'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </loader>
Nov 27 04:34:38 user nova-compute[75260]:   </os>
Nov 27 04:34:38 user nova-compute[75260]:   <cpu>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-passthrough' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='hostPassthroughMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='maximum' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='maximumMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-model' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <vendor>Intel</vendor>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ss'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='vmx'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pcid'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='hypervisor'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arat'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='umip'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='md-clear'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibpb'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibrs'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='erms'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='lm'/>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='custom' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>qemu64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>qemu32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>phenom</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>n270</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>kvm64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>coreduo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>core2duo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>athlon</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Westmere</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Snowridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Penryn</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G5</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G4</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G1</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Nehalem</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Rome</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Milan</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Dhyana</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cooperlake</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Conroe</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>486</model>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:   </cpu>
Nov 27 04:34:38 user nova-compute[75260]:   <memoryBacking supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='sourceType'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>file</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>anonymous</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>memfd</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:   </memoryBacking>
Nov 27 04:34:38 user nova-compute[75260]:   <devices>
Nov 27 04:34:38 user nova-compute[75260]:     <disk supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='diskDevice'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>disk</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cdrom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>floppy</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>lun</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='bus'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>fdc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sata</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </disk>
Nov 27 04:34:38 user nova-compute[75260]:     <graphics supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sdl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vnc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>spice</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egl-headless</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </graphics>
Nov 27 04:34:38 user nova-compute[75260]:     <video supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='modelType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cirrus</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vmvga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>qxl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>none</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>bochs</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ramfb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </video>
Nov 27 04:34:38 user nova-compute[75260]:     <hostdev supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='mode'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>subsystem</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='startupPolicy'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>default</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>mandatory</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>requisite</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>optional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='subsysType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pci</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='capsType'/>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='pciBackend'/>
Nov 27 04:34:38 user nova-compute[75260]:     </hostdev>
Nov 27 04:34:38 user nova-compute[75260]:     <rng supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>random</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egd</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>builtin</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </rng>
Nov 27 04:34:38 user nova-compute[75260]:     <filesystem supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='driverType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>path</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>handle</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtiofs</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </filesystem>
Nov 27 04:34:38 user nova-compute[75260]:     <tpm supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-tis</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-crb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>passthrough</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>emulator</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </tpm>
Nov 27 04:34:38 user nova-compute[75260]:   </devices>
Nov 27 04:34:38 user nova-compute[75260]:   <features>
Nov 27 04:34:38 user nova-compute[75260]:     <gic supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     <vmcoreinfo supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <genid supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backingStoreInput supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backup supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <sev supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:   </features>
Nov 27 04:34:38 user nova-compute[75260]: </domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:  {{(pid=75260) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 27 04:34:38 user nova-compute[75260]: <domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 04:34:38 user nova-compute[75260]:   <domain>kvm</domain>
Nov 27 04:34:38 user nova-compute[75260]:   <machine>pc-i440fx-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:   <arch>i686</arch>
Nov 27 04:34:38 user nova-compute[75260]:   <vcpu max='255'/>
Nov 27 04:34:38 user nova-compute[75260]:   <iothreads supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:   <os supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='firmware'/>
Nov 27 04:34:38 user nova-compute[75260]:     <loader supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>rom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pflash</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='readonly'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>yes</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='secure'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </loader>
Nov 27 04:34:38 user nova-compute[75260]:   </os>
Nov 27 04:34:38 user nova-compute[75260]:   <cpu>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-passthrough' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='hostPassthroughMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='maximum' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='maximumMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-model' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <vendor>Intel</vendor>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ss'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='vmx'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pcid'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='hypervisor'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arat'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='umip'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='md-clear'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibpb'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibrs'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='erms'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='lm'/>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='custom' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>qemu64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>qemu32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>phenom</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>n270</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>kvm64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>coreduo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>core2duo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>athlon</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Westmere</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Snowridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Penryn</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G5</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G4</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G1</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Nehalem</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Rome</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Milan</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Dhyana</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cooperlake</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Conroe</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>486</model>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:   </cpu>
Nov 27 04:34:38 user nova-compute[75260]:   <memoryBacking supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='sourceType'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>file</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>anonymous</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>memfd</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:   </memoryBacking>
Nov 27 04:34:38 user nova-compute[75260]:   <devices>
Nov 27 04:34:38 user nova-compute[75260]:     <disk supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='diskDevice'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>disk</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cdrom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>floppy</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>lun</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='bus'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ide</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>fdc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sata</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </disk>
Nov 27 04:34:38 user nova-compute[75260]:     <graphics supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sdl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vnc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>spice</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egl-headless</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </graphics>
Nov 27 04:34:38 user nova-compute[75260]:     <video supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='modelType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cirrus</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vmvga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>qxl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>none</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>bochs</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ramfb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </video>
Nov 27 04:34:38 user nova-compute[75260]:     <hostdev supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='mode'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>subsystem</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='startupPolicy'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>default</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>mandatory</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>requisite</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>optional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='subsysType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pci</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='capsType'/>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='pciBackend'/>
Nov 27 04:34:38 user nova-compute[75260]:     </hostdev>
Nov 27 04:34:38 user nova-compute[75260]:     <rng supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>random</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egd</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>builtin</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </rng>
Nov 27 04:34:38 user nova-compute[75260]:     <filesystem supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='driverType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>path</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>handle</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtiofs</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </filesystem>
Nov 27 04:34:38 user nova-compute[75260]:     <tpm supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-tis</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-crb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>passthrough</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>emulator</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </tpm>
Nov 27 04:34:38 user nova-compute[75260]:   </devices>
Nov 27 04:34:38 user nova-compute[75260]:   <features>
Nov 27 04:34:38 user nova-compute[75260]:     <gic supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     <vmcoreinfo supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <genid supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backingStoreInput supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backup supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <sev supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:   </features>
Nov 27 04:34:38 user nova-compute[75260]: </domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:  {{(pid=75260) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 27 04:34:38 user nova-compute[75260]: <domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 04:34:38 user nova-compute[75260]:   <domain>kvm</domain>
Nov 27 04:34:38 user nova-compute[75260]:   <machine>pc-q35-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:   <arch>i686</arch>
Nov 27 04:34:38 user nova-compute[75260]:   <vcpu max='288'/>
Nov 27 04:34:38 user nova-compute[75260]:   <iothreads supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:   <os supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='firmware'/>
Nov 27 04:34:38 user nova-compute[75260]:     <loader supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>rom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pflash</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='readonly'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>yes</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='secure'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </loader>
Nov 27 04:34:38 user nova-compute[75260]:   </os>
Nov 27 04:34:38 user nova-compute[75260]:   <cpu>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-passthrough' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='hostPassthroughMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='maximum' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='maximumMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-model' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <vendor>Intel</vendor>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ss'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='vmx'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pcid'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='hypervisor'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arat'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='umip'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='md-clear'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibpb'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibrs'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='erms'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='lm'/>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='custom' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>qemu64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>qemu32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>phenom</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>n270</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>kvm64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>coreduo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>core2duo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>athlon</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Westmere</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Snowridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Penryn</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G5</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G4</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G1</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Nehalem</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Rome</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Milan</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Dhyana</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cooperlake</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Conroe</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>486</model>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:   </cpu>
Nov 27 04:34:38 user nova-compute[75260]:   <memoryBacking supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='sourceType'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>file</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>anonymous</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>memfd</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:   </memoryBacking>
Nov 27 04:34:38 user nova-compute[75260]:   <devices>
Nov 27 04:34:38 user nova-compute[75260]:     <disk supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='diskDevice'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>disk</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cdrom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>floppy</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>lun</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='bus'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>fdc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sata</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </disk>
Nov 27 04:34:38 user nova-compute[75260]:     <graphics supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sdl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vnc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>spice</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egl-headless</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </graphics>
Nov 27 04:34:38 user nova-compute[75260]:     <video supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='modelType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cirrus</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vmvga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>qxl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>none</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>bochs</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ramfb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </video>
Nov 27 04:34:38 user nova-compute[75260]:     <hostdev supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='mode'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>subsystem</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='startupPolicy'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>default</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>mandatory</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>requisite</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>optional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='subsysType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pci</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='capsType'/>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='pciBackend'/>
Nov 27 04:34:38 user nova-compute[75260]:     </hostdev>
Nov 27 04:34:38 user nova-compute[75260]:     <rng supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>random</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egd</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>builtin</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </rng>
Nov 27 04:34:38 user nova-compute[75260]:     <filesystem supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='driverType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>path</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>handle</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtiofs</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </filesystem>
Nov 27 04:34:38 user nova-compute[75260]:     <tpm supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-tis</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-crb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>passthrough</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>emulator</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </tpm>
Nov 27 04:34:38 user nova-compute[75260]:   </devices>
Nov 27 04:34:38 user nova-compute[75260]:   <features>
Nov 27 04:34:38 user nova-compute[75260]:     <gic supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     <vmcoreinfo supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <genid supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backingStoreInput supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backup supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <sev supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:   </features>
Nov 27 04:34:38 user nova-compute[75260]: </domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:  {{(pid=75260) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 27 04:34:38 user nova-compute[75260]: <domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 04:34:38 user nova-compute[75260]:   <domain>kvm</domain>
Nov 27 04:34:38 user nova-compute[75260]:   <machine>pc-i440fx-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:   <arch>i686</arch>
Nov 27 04:34:38 user nova-compute[75260]:   <vcpu max='255'/>
Nov 27 04:34:38 user nova-compute[75260]:   <iothreads supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:   <os supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='firmware'/>
Nov 27 04:34:38 user nova-compute[75260]:     <loader supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>rom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pflash</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='readonly'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>yes</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='secure'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </loader>
Nov 27 04:34:38 user nova-compute[75260]:   </os>
Nov 27 04:34:38 user nova-compute[75260]:   <cpu>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-passthrough' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='hostPassthroughMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='maximum' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='maximumMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-model' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <vendor>Intel</vendor>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ss'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='vmx'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pcid'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='hypervisor'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arat'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='umip'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='md-clear'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibpb'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibrs'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='erms'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='lm'/>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='custom' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>qemu64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>qemu32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>phenom</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>n270</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>kvm64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>coreduo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>core2duo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>athlon</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Westmere</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Snowridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Penryn</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G5</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G4</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G1</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Nehalem</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Rome</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Milan</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Dhyana</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cooperlake</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Conroe</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>486</model>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:   </cpu>
Nov 27 04:34:38 user nova-compute[75260]:   <memoryBacking supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='sourceType'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>file</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>anonymous</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>memfd</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:   </memoryBacking>
Nov 27 04:34:38 user nova-compute[75260]:   <devices>
Nov 27 04:34:38 user nova-compute[75260]:     <disk supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='diskDevice'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>disk</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cdrom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>floppy</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>lun</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='bus'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ide</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>fdc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sata</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </disk>
Nov 27 04:34:38 user nova-compute[75260]:     <graphics supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sdl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vnc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>spice</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egl-headless</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </graphics>
Nov 27 04:34:38 user nova-compute[75260]:     <video supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='modelType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cirrus</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vmvga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>qxl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>none</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>bochs</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ramfb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </video>
Nov 27 04:34:38 user nova-compute[75260]:     <hostdev supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='mode'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>subsystem</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='startupPolicy'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>default</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>mandatory</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>requisite</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>optional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='subsysType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pci</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='capsType'/>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='pciBackend'/>
Nov 27 04:34:38 user nova-compute[75260]:     </hostdev>
Nov 27 04:34:38 user nova-compute[75260]:     <rng supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>random</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egd</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>builtin</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </rng>
Nov 27 04:34:38 user nova-compute[75260]:     <filesystem supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='driverType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>path</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>handle</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtiofs</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </filesystem>
Nov 27 04:34:38 user nova-compute[75260]:     <tpm supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-tis</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-crb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>passthrough</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>emulator</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </tpm>
Nov 27 04:34:38 user nova-compute[75260]:   </devices>
Nov 27 04:34:38 user nova-compute[75260]:   <features>
Nov 27 04:34:38 user nova-compute[75260]:     <gic supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     <vmcoreinfo supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <genid supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backingStoreInput supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backup supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <sev supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:   </features>
Nov 27 04:34:38 user nova-compute[75260]: </domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:  {{(pid=75260) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 27 04:34:38 user nova-compute[75260]: <domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 04:34:38 user nova-compute[75260]:   <domain>kvm</domain>
Nov 27 04:34:38 user nova-compute[75260]:   <machine>pc-q35-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:   <arch>x86_64</arch>
Nov 27 04:34:38 user nova-compute[75260]:   <vcpu max='288'/>
Nov 27 04:34:38 user nova-compute[75260]:   <iothreads supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:   <os supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='firmware'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>efi</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:     <loader supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>rom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pflash</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='readonly'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>yes</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='secure'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>yes</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </loader>
Nov 27 04:34:38 user nova-compute[75260]:   </os>
Nov 27 04:34:38 user nova-compute[75260]:   <cpu>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-passthrough' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='hostPassthroughMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='maximum' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='maximumMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-model' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <vendor>Intel</vendor>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ss'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='vmx'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pcid'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='hypervisor'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arat'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='umip'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='md-clear'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='invtsc'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibpb'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibrs'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='rsba'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='erms'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='custom' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>qemu64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>qemu32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>phenom</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>n270</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>coreduo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>core2duo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>athlon</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Westmere</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Snowridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Penryn</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G5</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G4</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Opteron_G1</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Nehalem</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Rome</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Milan</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Dhyana</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cooperlake</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Conroe</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>486</model>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:   </cpu>
Nov 27 04:34:38 user nova-compute[75260]:   <memoryBacking supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='sourceType'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>file</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>anonymous</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>memfd</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:   </memoryBacking>
Nov 27 04:34:38 user nova-compute[75260]:   <devices>
Nov 27 04:34:38 user nova-compute[75260]:     <disk supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='diskDevice'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>disk</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cdrom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>floppy</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>lun</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='bus'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>fdc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sata</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </disk>
Nov 27 04:34:38 user nova-compute[75260]:     <graphics supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sdl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vnc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>spice</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egl-headless</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </graphics>
Nov 27 04:34:38 user nova-compute[75260]:     <video supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='modelType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cirrus</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vmvga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>qxl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>none</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>bochs</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ramfb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </video>
Nov 27 04:34:38 user nova-compute[75260]:     <hostdev supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='mode'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>subsystem</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='startupPolicy'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>default</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>mandatory</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>requisite</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>optional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='subsysType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pci</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='capsType'/>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='pciBackend'/>
Nov 27 04:34:38 user nova-compute[75260]:     </hostdev>
Nov 27 04:34:38 user nova-compute[75260]:     <rng supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>random</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egd</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>builtin</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </rng>
Nov 27 04:34:38 user nova-compute[75260]:     <filesystem supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='driverType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>path</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>handle</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtiofs</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </filesystem>
Nov 27 04:34:38 user nova-compute[75260]:     <tpm supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-tis</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-crb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>passthrough</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>emulator</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </tpm>
Nov 27 04:34:38 user nova-compute[75260]:   </devices>
Nov 27 04:34:38 user nova-compute[75260]:   <features>
Nov 27 04:34:38 user nova-compute[75260]:     <gic supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     <vmcoreinfo supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <genid supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backingStoreInput supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backup supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <sev supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:   </features>
Nov 27 04:34:38 user nova-compute[75260]: </domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:  {{(pid=75260) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 27 04:34:38 user nova-compute[75260]: <domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 04:34:38 user nova-compute[75260]:   <domain>kvm</domain>
Nov 27 04:34:38 user nova-compute[75260]:   <machine>pc-i440fx-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:   <arch>x86_64</arch>
Nov 27 04:34:38 user nova-compute[75260]:   <vcpu max='255'/>
Nov 27 04:34:38 user nova-compute[75260]:   <iothreads supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:   <os supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='firmware'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>efi</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:     <loader supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>rom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pflash</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='readonly'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>yes</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='secure'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </loader>
Nov 27 04:34:38 user nova-compute[75260]:   </os>
Nov 27 04:34:38 user nova-compute[75260]:   <cpu>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-passthrough' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='hostPassthroughMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='maximum' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='maximumMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-model' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <vendor>Intel</vendor>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ss'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='vmx'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pcid'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='hypervisor'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arat'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='umip'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='md-clear'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='invtsc'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibpb'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibrs'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='rsba'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='erms'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='custom' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>qemu64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>qemu32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>phenom</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>n270</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>coreduo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>core2duo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>athlon</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Westmere</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Snowridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Penryn</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G5</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G4</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Opteron_G1</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Nehalem</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Rome</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Milan</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Dhyana</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cooperlake</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Conroe</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>486</model>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:   </cpu>
Nov 27 04:34:38 user nova-compute[75260]:   <memoryBacking supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='sourceType'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>file</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>anonymous</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>memfd</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:   </memoryBacking>
Nov 27 04:34:38 user nova-compute[75260]:   <devices>
Nov 27 04:34:38 user nova-compute[75260]:     <disk supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='diskDevice'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>disk</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cdrom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>floppy</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>lun</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='bus'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ide</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>fdc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sata</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </disk>
Nov 27 04:34:38 user nova-compute[75260]:     <graphics supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sdl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vnc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>spice</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egl-headless</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </graphics>
Nov 27 04:34:38 user nova-compute[75260]:     <video supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='modelType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cirrus</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vmvga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>qxl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>none</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>bochs</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ramfb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </video>
Nov 27 04:34:38 user nova-compute[75260]:     <hostdev supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='mode'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>subsystem</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='startupPolicy'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>default</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>mandatory</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>requisite</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>optional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='subsysType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pci</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='capsType'/>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='pciBackend'/>
Nov 27 04:34:38 user nova-compute[75260]:     </hostdev>
Nov 27 04:34:38 user nova-compute[75260]:     <rng supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>random</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egd</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>builtin</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </rng>
Nov 27 04:34:38 user nova-compute[75260]:     <filesystem supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='driverType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>path</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>handle</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtiofs</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </filesystem>
Nov 27 04:34:38 user nova-compute[75260]:     <tpm supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-tis</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-crb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>passthrough</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>emulator</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </tpm>
Nov 27 04:34:38 user nova-compute[75260]:   </devices>
Nov 27 04:34:38 user nova-compute[75260]:   <features>
Nov 27 04:34:38 user nova-compute[75260]:     <gic supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     <vmcoreinfo supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <genid supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backingStoreInput supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backup supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <sev supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:   </features>
Nov 27 04:34:38 user nova-compute[75260]: </domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:  {{(pid=75260) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 27 04:34:38 user nova-compute[75260]: <domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 04:34:38 user nova-compute[75260]:   <domain>kvm</domain>
Nov 27 04:34:38 user nova-compute[75260]:   <machine>pc-q35-6.2</machine>
Nov 27 04:34:38 user nova-compute[75260]:   <arch>x86_64</arch>
Nov 27 04:34:38 user nova-compute[75260]:   <vcpu max='288'/>
Nov 27 04:34:38 user nova-compute[75260]:   <iothreads supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:   <os supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='firmware'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>efi</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:     <loader supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>rom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pflash</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='readonly'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>yes</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='secure'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>yes</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </loader>
Nov 27 04:34:38 user nova-compute[75260]:   </os>
Nov 27 04:34:38 user nova-compute[75260]:   <cpu>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-passthrough' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='hostPassthroughMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='maximum' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='maximumMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-model' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <vendor>Intel</vendor>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ss'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='vmx'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pcid'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='hypervisor'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arat'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='umip'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='md-clear'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='invtsc'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibpb'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibrs'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='rsba'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='erms'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='custom' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>qemu64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>qemu32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>phenom</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>n270</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>coreduo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>core2duo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>athlon</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Westmere</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Snowridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Penryn</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G5</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G4</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Opteron_G1</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Nehalem</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Rome</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Milan</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Dhyana</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cooperlake</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Conroe</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>486</model>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:   </cpu>
Nov 27 04:34:38 user nova-compute[75260]:   <memoryBacking supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='sourceType'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>file</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>anonymous</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>memfd</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:   </memoryBacking>
Nov 27 04:34:38 user nova-compute[75260]:   <devices>
Nov 27 04:34:38 user nova-compute[75260]:     <disk supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='diskDevice'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>disk</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cdrom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>floppy</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>lun</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='bus'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>fdc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sata</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </disk>
Nov 27 04:34:38 user nova-compute[75260]:     <graphics supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sdl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vnc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>spice</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egl-headless</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </graphics>
Nov 27 04:34:38 user nova-compute[75260]:     <video supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='modelType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cirrus</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vmvga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>qxl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>none</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>bochs</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ramfb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </video>
Nov 27 04:34:38 user nova-compute[75260]:     <hostdev supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='mode'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>subsystem</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='startupPolicy'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>default</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>mandatory</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>requisite</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>optional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='subsysType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pci</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='capsType'/>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='pciBackend'/>
Nov 27 04:34:38 user nova-compute[75260]:     </hostdev>
Nov 27 04:34:38 user nova-compute[75260]:     <rng supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>random</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egd</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>builtin</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </rng>
Nov 27 04:34:38 user nova-compute[75260]:     <filesystem supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='driverType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>path</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>handle</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtiofs</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </filesystem>
Nov 27 04:34:38 user nova-compute[75260]:     <tpm supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-tis</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-crb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>passthrough</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>emulator</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </tpm>
Nov 27 04:34:38 user nova-compute[75260]:   </devices>
Nov 27 04:34:38 user nova-compute[75260]:   <features>
Nov 27 04:34:38 user nova-compute[75260]:     <gic supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     <vmcoreinfo supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <genid supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backingStoreInput supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backup supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <sev supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:   </features>
Nov 27 04:34:38 user nova-compute[75260]: </domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:  {{(pid=75260) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 27 04:34:38 user nova-compute[75260]: <domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 04:34:38 user nova-compute[75260]:   <domain>kvm</domain>
Nov 27 04:34:38 user nova-compute[75260]:   <machine>pc-i440fx-jammy</machine>
Nov 27 04:34:38 user nova-compute[75260]:   <arch>x86_64</arch>
Nov 27 04:34:38 user nova-compute[75260]:   <vcpu max='255'/>
Nov 27 04:34:38 user nova-compute[75260]:   <iothreads supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:   <os supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='firmware'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>efi</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:     <loader supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>rom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pflash</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='readonly'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>yes</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='secure'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>no</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </loader>
Nov 27 04:34:38 user nova-compute[75260]:   </os>
Nov 27 04:34:38 user nova-compute[75260]:   <cpu>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-passthrough' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='hostPassthroughMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='maximum' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='maximumMigratable'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>on</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>off</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='host-model' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <vendor>Intel</vendor>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ss'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='vmx'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pcid'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='hypervisor'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arat'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='umip'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='md-clear'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='invtsc'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibpb'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='ibrs'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-stibp'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='rsba'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='erms'/>
Nov 27 04:34:38 user nova-compute[75260]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:     <mode name='custom' supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>qemu64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>qemu32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>phenom</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>pentium</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>n270</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm64</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>kvm32</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>coreduo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>core2duo</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>athlon</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Westmere</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Snowridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Skylake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>SandyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Penryn</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G5</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G4</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G3</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Opteron_G2</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Opteron_G1</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Nehalem</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>IvyBridge</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Icelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Haswell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Rome</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-Milan</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>EPYC</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Dhyana</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cooperlake</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>Conroe</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='no'>Broadwell</model>
Nov 27 04:34:38 user nova-compute[75260]:       <model usable='yes'>486</model>
Nov 27 04:34:38 user nova-compute[75260]:     </mode>
Nov 27 04:34:38 user nova-compute[75260]:   </cpu>
Nov 27 04:34:38 user nova-compute[75260]:   <memoryBacking supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:     <enum name='sourceType'>
Nov 27 04:34:38 user nova-compute[75260]:       <value>file</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>anonymous</value>
Nov 27 04:34:38 user nova-compute[75260]:       <value>memfd</value>
Nov 27 04:34:38 user nova-compute[75260]:     </enum>
Nov 27 04:34:38 user nova-compute[75260]:   </memoryBacking>
Nov 27 04:34:38 user nova-compute[75260]:   <devices>
Nov 27 04:34:38 user nova-compute[75260]:     <disk supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='diskDevice'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>disk</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cdrom</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>floppy</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>lun</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='bus'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ide</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>fdc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sata</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </disk>
Nov 27 04:34:38 user nova-compute[75260]:     <graphics supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='type'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>sdl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vnc</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>spice</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egl-headless</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </graphics>
Nov 27 04:34:38 user nova-compute[75260]:     <video supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='modelType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>cirrus</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>vmvga</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>qxl</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>none</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>bochs</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>ramfb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </video>
Nov 27 04:34:38 user nova-compute[75260]:     <hostdev supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='mode'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>subsystem</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='startupPolicy'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>default</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>mandatory</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>requisite</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>optional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='subsysType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>usb</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>pci</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>scsi</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='capsType'/>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='pciBackend'/>
Nov 27 04:34:38 user nova-compute[75260]:     </hostdev>
Nov 27 04:34:38 user nova-compute[75260]:     <rng supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtio-non-transitional</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>random</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>egd</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>builtin</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </rng>
Nov 27 04:34:38 user nova-compute[75260]:     <filesystem supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='driverType'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>path</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>handle</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>virtiofs</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </filesystem>
Nov 27 04:34:38 user nova-compute[75260]:     <tpm supported='yes'>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='model'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-tis</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>tpm-crb</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:       <enum name='backendModel'>
Nov 27 04:34:38 user nova-compute[75260]:         <value>passthrough</value>
Nov 27 04:34:38 user nova-compute[75260]:         <value>emulator</value>
Nov 27 04:34:38 user nova-compute[75260]:       </enum>
Nov 27 04:34:38 user nova-compute[75260]:     </tpm>
Nov 27 04:34:38 user nova-compute[75260]:   </devices>
Nov 27 04:34:38 user nova-compute[75260]:   <features>
Nov 27 04:34:38 user nova-compute[75260]:     <gic supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:     <vmcoreinfo supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <genid supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backingStoreInput supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <backup supported='yes'/>
Nov 27 04:34:38 user nova-compute[75260]:     <sev supported='no'/>
Nov 27 04:34:38 user nova-compute[75260]:   </features>
Nov 27 04:34:38 user nova-compute[75260]: </domainCapabilities>
Nov 27 04:34:38 user nova-compute[75260]:  {{(pid=75260) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75260) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75260) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Checking secure boot support for host arch (x86_64) {{(pid=75260) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 27 04:34:38 user nova-compute[75260]: INFO nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Secure Boot support detected
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] cpu compare xml: <cpu match="exact">
Nov 27 04:34:38 user nova-compute[75260]:   <model>Nehalem</model>
Nov 27 04:34:38 user nova-compute[75260]: </cpu>
Nov 27 04:34:38 user nova-compute[75260]:  {{(pid=75260) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 27 04:34:38 user nova-compute[75260]: INFO nova.virt.node [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Generated node identity f7a986a0-eb41-409b-bde9-ec0b97496a7b
Nov 27 04:34:38 user nova-compute[75260]: INFO nova.virt.node [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Wrote node identity f7a986a0-eb41-409b-bde9-ec0b97496a7b to /opt/stack/data/nova/compute_id
Nov 27 04:34:38 user nova-compute[75260]: WARNING nova.compute.manager [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Compute nodes ['f7a986a0-eb41-409b-bde9-ec0b97496a7b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 27 04:34:38 user nova-compute[75260]: INFO nova.compute.manager [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 27 04:34:38 user nova-compute[75260]: WARNING nova.compute.manager [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 27 04:34:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:34:38 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:34:39 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:34:39 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Hypervisor/Node resource view: name=user free_ram=10952MB free_disk=26.26042938232422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:34:39 user nova-compute[75260]: WARNING nova.compute.resource_tracker [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] No compute node record for user:f7a986a0-eb41-409b-bde9-ec0b97496a7b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f7a986a0-eb41-409b-bde9-ec0b97496a7b could not be found.
Nov 27 04:34:39 user nova-compute[75260]: INFO nova.compute.resource_tracker [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Compute node record created for user:user with uuid: f7a986a0-eb41-409b-bde9-ec0b97496a7b
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:34:39 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] [req-eee975ff-08bb-4661-ba3c-8fa6d2072904] Created resource provider record via placement API for resource provider with UUID f7a986a0-eb41-409b-bde9-ec0b97496a7b and name user.
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75260) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 27 04:34:39 user nova-compute[75260]: INFO nova.virt.libvirt.host [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] kernel doesn't support AMD SEV
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Libvirt baseline CPU <cpu>
Nov 27 04:34:39 user nova-compute[75260]:   <arch>x86_64</arch>
Nov 27 04:34:39 user nova-compute[75260]:   <model>Nehalem</model>
Nov 27 04:34:39 user nova-compute[75260]:   <vendor>Intel</vendor>
Nov 27 04:34:39 user nova-compute[75260]:   <topology sockets="6" cores="1" threads="1"/>
Nov 27 04:34:39 user nova-compute[75260]: </cpu>
Nov 27 04:34:39 user nova-compute[75260]:  {{(pid=75260) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Updated inventory for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Updating resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b generation from 0 to 1 during operation: update_inventory {{(pid=75260) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Updating resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b generation from 1 to 2 during operation: update_traits {{(pid=75260) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.service [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Creating RPC server for service compute {{(pid=75260) start /opt/stack/nova/nova/service.py:182}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.service [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] Join ServiceGroup membership for this service compute {{(pid=75260) start /opt/stack/nova/nova/service.py:199}}
Nov 27 04:34:39 user nova-compute[75260]: DEBUG nova.servicegroup.drivers.db [None req-e85e06e0-f685-42e9-b808-7e0cba940612 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75260) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 27 04:34:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:34:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:35:30 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:35:31 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:35:31 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:35:31 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=10413MB free_disk=26.164173126220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:35:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:35:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:35:31 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:35:31 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:35:31 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:35:31 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:35:31 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:35:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:36:31 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:36:31 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:36:31 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=10330MB free_disk=26.229209899902344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:36:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:36:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:36:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:36:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:36:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 04:36:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:36:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:36:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:36:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:36:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:36:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:37:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:37:31 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:37:31 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:37:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:37:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:37:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:37:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:37:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 04:37:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:37:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:37:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:37:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:37:32 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:37:33 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:37:33 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:37:33 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=10321MB free_disk=25.981006622314453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:37:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:37:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:37:33 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:37:33 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:37:33 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:37:33 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:37:33 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:37:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:37:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:37:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:37:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:37:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:38:31 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:38:31 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:38:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:38:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:38:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:32 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:38:33 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:38:33 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:38:33 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=9637MB free_disk=26.009971618652344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:38:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:33 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:38:33 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:38:33 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:38:33 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:38:33 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:38:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:38:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:38:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:38:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:38:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:38:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 04:38:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:38:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:38:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:38:35 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:38:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "7c01d799-540f-469b-8417-5af70d803adf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:41 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:38:42 user nova-compute[75260]: INFO nova.compute.claims [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Claim successful on node user
Nov 27 04:38:42 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG nova.network.neutron [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:38:42 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:38:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:38:42 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Creating image(s)
Nov 27 04:38:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:43 user nova-compute[75260]: DEBUG nova.policy [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41069f4d1d404da19dcfb2a3552fcddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f7694b2294e16aec0248f1217b148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:38:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86.part --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:43 user nova-compute[75260]: DEBUG nova.virt.images [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] a58facc7-83af-4098-886e-ccf8b18b0095 was qcow2, converting to raw {{(pid=75260) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 04:38:43 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 04:38:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86.part /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86.converted {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86.part /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86.converted" returned: 0 in 0.147s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86.converted --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:38:44 user nova-compute[75260]: INFO nova.compute.claims [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Claim successful on node user
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.433s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:44 user nova-compute[75260]: INFO oslo.privsep.daemon [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpr8i2sjkj/privsep.sock']
Nov 27 04:38:44 user sudo[84510]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpr8i2sjkj/privsep.sock
Nov 27 04:38:44 user sudo[84510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 27 04:38:44 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:38:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:38:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:38:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Creating image(s)
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:45 user nova-compute[75260]: DEBUG nova.policy [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41069f4d1d404da19dcfb2a3552fcddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f7694b2294e16aec0248f1217b148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:38:45 user sudo[84510]: pam_unix(sudo:session): session closed for user root
Nov 27 04:38:45 user nova-compute[75260]: INFO oslo.privsep.daemon [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Spawned new privsep daemon via rootwrap
Nov 27 04:38:45 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 27 04:38:45 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 27 04:38:45 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 27 04:38:45 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84513
Nov 27 04:38:45 user nova-compute[75260]: WARNING oslo_privsep.priv_context [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] privsep daemon already running
Nov 27 04:38:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.158s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk 1073741824" returned: 0 in 0.060s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.220s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.159s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Successfully created port: 240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk 1073741824" returned: 0 in 0.046s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Cannot resize image /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Ensure instance console log exists: /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Cannot resize image /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Ensure instance console log exists: /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Successfully created port: 3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG nova.network.neutron [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Successfully updated port: 240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquired lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG nova.network.neutron [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG nova.network.neutron [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-a38220d8-c13c-4e26-a8ce-ce9253031611 req-f146d8d1-a666-4813-ba0a-4a69ca03e783 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-changed-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-a38220d8-c13c-4e26-a8ce-ce9253031611 req-f146d8d1-a666-4813-ba0a-4a69ca03e783 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Refreshing instance network info cache due to event network-changed-240c5141-ac9c-45d3-ba42-5e854ceee9ed. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a38220d8-c13c-4e26-a8ce-ce9253031611 req-f146d8d1-a666-4813-ba0a-4a69ca03e783 service nova] Acquiring lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG nova.network.neutron [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Successfully updated port: 3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquired lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:38:48 user nova-compute[75260]: DEBUG nova.network.neutron [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.neutron [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.neutron [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updating instance_info_cache with network_info: [{"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Releasing lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Instance network_info: |[{"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a38220d8-c13c-4e26-a8ce-ce9253031611 req-f146d8d1-a666-4813-ba0a-4a69ca03e783 service nova] Acquired lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.neutron [req-a38220d8-c13c-4e26-a8ce-ce9253031611 req-f146d8d1-a666-4813-ba0a-4a69ca03e783 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Refreshing network info cache for port 240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Start _get_guest_xml network_info=[{"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:38:49 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:38:49 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1181510226',display_name='tempest-ServerRescueNegativeTestJSON-server-1181510226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1181510226',id=1,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-3w0rf0rf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:43Z,user_data=None,user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=7c01d799-540f-469b-8417-5af70d803adf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:25:f7,bridge_name='br-int',has_traffic_filtering=True,id=240c5141-ac9c-45d3-ba42-5e854ceee9ed,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240c5141-ac') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:38:49 user nova-compute[75260]:   <uuid>7c01d799-540f-469b-8417-5af70d803adf</uuid>
Nov 27 04:38:49 user nova-compute[75260]:   <name>instance-00000001</name>
Nov 27 04:38:49 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:38:49 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:38:49 user nova-compute[75260]:   <metadata>
Nov 27 04:38:49 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:38:49 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1181510226</nova:name>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:38:49</nova:creationTime>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:38:49 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:38:49 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:owner>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:user uuid="41069f4d1d404da19dcfb2a3552fcddb">tempest-ServerRescueNegativeTestJSON-1319145768-project-member</nova:user>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:project uuid="0e5f7694b2294e16aec0248f1217b148">tempest-ServerRescueNegativeTestJSON-1319145768</nova:project>
Nov 27 04:38:49 user nova-compute[75260]:       </nova:owner>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:ports>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:port uuid="240c5141-ac9c-45d3-ba42-5e854ceee9ed">
Nov 27 04:38:49 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:38:49 user nova-compute[75260]:         </nova:port>
Nov 27 04:38:49 user nova-compute[75260]:       </nova:ports>
Nov 27 04:38:49 user nova-compute[75260]:     </nova:instance>
Nov 27 04:38:49 user nova-compute[75260]:   </metadata>
Nov 27 04:38:49 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:38:49 user nova-compute[75260]:     <system>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="serial">7c01d799-540f-469b-8417-5af70d803adf</entry>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="uuid">7c01d799-540f-469b-8417-5af70d803adf</entry>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:38:49 user nova-compute[75260]:     </system>
Nov 27 04:38:49 user nova-compute[75260]:   </sysinfo>
Nov 27 04:38:49 user nova-compute[75260]:   <os>
Nov 27 04:38:49 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:38:49 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:38:49 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:38:49 user nova-compute[75260]:   </os>
Nov 27 04:38:49 user nova-compute[75260]:   <features>
Nov 27 04:38:49 user nova-compute[75260]:     <acpi/>
Nov 27 04:38:49 user nova-compute[75260]:     <apic/>
Nov 27 04:38:49 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:38:49 user nova-compute[75260]:   </features>
Nov 27 04:38:49 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:38:49 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:38:49 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:38:49 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:38:49 user nova-compute[75260]:   </clock>
Nov 27 04:38:49 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:38:49 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:38:49 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:38:49 user nova-compute[75260]:   </cpu>
Nov 27 04:38:49 user nova-compute[75260]:   <devices>
Nov 27 04:38:49 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:38:49 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:38:49 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk"/>
Nov 27 04:38:49 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:38:49 user nova-compute[75260]:     </disk>
Nov 27 04:38:49 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:38:49 user nova-compute[75260]:       <mac address="fa:16:3e:a5:25:f7"/>
Nov 27 04:38:49 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:38:49 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:38:49 user nova-compute[75260]:       <target dev="tap240c5141-ac"/>
Nov 27 04:38:49 user nova-compute[75260]:     </interface>
Nov 27 04:38:49 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:38:49 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/console.log" append="off"/>
Nov 27 04:38:49 user nova-compute[75260]:     </serial>
Nov 27 04:38:49 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:38:49 user nova-compute[75260]:     <video>
Nov 27 04:38:49 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:38:49 user nova-compute[75260]:     </video>
Nov 27 04:38:49 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:38:49 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:38:49 user nova-compute[75260]:     </rng>
Nov 27 04:38:49 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:38:49 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:38:49 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:38:49 user nova-compute[75260]:     </memballoon>
Nov 27 04:38:49 user nova-compute[75260]:   </devices>
Nov 27 04:38:49 user nova-compute[75260]: </domain>
Nov 27 04:38:49 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1181510226',display_name='tempest-ServerRescueNegativeTestJSON-server-1181510226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1181510226',id=1,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-3w0rf0rf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:43Z,user_data=None,user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=7c01d799-540f-469b-8417-5af70d803adf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:25:f7,bridge_name='br-int',has_traffic_filtering=True,id=240c5141-ac9c-45d3-ba42-5e854ceee9ed,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240c5141-ac') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG os_vif [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:25:f7,bridge_name='br-int',has_traffic_filtering=True,id=240c5141-ac9c-45d3-ba42-5e854ceee9ed,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240c5141-ac') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Created schema index Interface.name {{(pid=75260) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Created schema index Port.name {{(pid=75260) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Created schema index Bridge.name {{(pid=75260) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [POLLOUT] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7aaf85b3-55f9-5140-b06b-e6ce40b940c6', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:38:49 user nova-compute[75260]: INFO oslo.privsep.daemon [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpxwy6eixw/privsep.sock']
Nov 27 04:38:49 user sudo[84550]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpxwy6eixw/privsep.sock
Nov 27 04:38:49 user sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.neutron [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updating instance_info_cache with network_info: [{"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Releasing lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.compute.manager [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Instance network_info: |[{"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Start _get_guest_xml network_info=[{"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:38:49 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:38:49 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-802958880',display_name='tempest-ServerRescueNegativeTestJSON-server-802958880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-802958880',id=2,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-hpfh43sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:45Z,user_data=None,user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=d8cd1732-d408-4ef3-85b6-94b12ba7f5ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:85:32,bridge_name='br-int',has_traffic_filtering=True,id=3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9a12f-82') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.objects.instance [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'pci_devices' on Instance uuid d8cd1732-d408-4ef3-85b6-94b12ba7f5ad {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:38:49 user nova-compute[75260]:   <uuid>d8cd1732-d408-4ef3-85b6-94b12ba7f5ad</uuid>
Nov 27 04:38:49 user nova-compute[75260]:   <name>instance-00000002</name>
Nov 27 04:38:49 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:38:49 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:38:49 user nova-compute[75260]:   <metadata>
Nov 27 04:38:49 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:38:49 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-802958880</nova:name>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:38:49</nova:creationTime>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:38:49 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:38:49 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:owner>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:user uuid="41069f4d1d404da19dcfb2a3552fcddb">tempest-ServerRescueNegativeTestJSON-1319145768-project-member</nova:user>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:project uuid="0e5f7694b2294e16aec0248f1217b148">tempest-ServerRescueNegativeTestJSON-1319145768</nova:project>
Nov 27 04:38:49 user nova-compute[75260]:       </nova:owner>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:38:49 user nova-compute[75260]:       <nova:ports>
Nov 27 04:38:49 user nova-compute[75260]:         <nova:port uuid="3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e">
Nov 27 04:38:49 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 04:38:49 user nova-compute[75260]:         </nova:port>
Nov 27 04:38:49 user nova-compute[75260]:       </nova:ports>
Nov 27 04:38:49 user nova-compute[75260]:     </nova:instance>
Nov 27 04:38:49 user nova-compute[75260]:   </metadata>
Nov 27 04:38:49 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:38:49 user nova-compute[75260]:     <system>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="serial">d8cd1732-d408-4ef3-85b6-94b12ba7f5ad</entry>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="uuid">d8cd1732-d408-4ef3-85b6-94b12ba7f5ad</entry>
Nov 27 04:38:49 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:38:49 user nova-compute[75260]:     </system>
Nov 27 04:38:49 user nova-compute[75260]:   </sysinfo>
Nov 27 04:38:49 user nova-compute[75260]:   <os>
Nov 27 04:38:49 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:38:49 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:38:49 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:38:49 user nova-compute[75260]:   </os>
Nov 27 04:38:49 user nova-compute[75260]:   <features>
Nov 27 04:38:49 user nova-compute[75260]:     <acpi/>
Nov 27 04:38:49 user nova-compute[75260]:     <apic/>
Nov 27 04:38:49 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:38:49 user nova-compute[75260]:   </features>
Nov 27 04:38:49 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:38:49 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:38:49 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:38:49 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:38:49 user nova-compute[75260]:   </clock>
Nov 27 04:38:49 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:38:49 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:38:49 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:38:49 user nova-compute[75260]:   </cpu>
Nov 27 04:38:49 user nova-compute[75260]:   <devices>
Nov 27 04:38:49 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:38:49 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:38:49 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk"/>
Nov 27 04:38:49 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:38:49 user nova-compute[75260]:     </disk>
Nov 27 04:38:49 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:38:49 user nova-compute[75260]:       <mac address="fa:16:3e:b1:85:32"/>
Nov 27 04:38:49 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:38:49 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:38:49 user nova-compute[75260]:       <target dev="tap3ba9a12f-82"/>
Nov 27 04:38:49 user nova-compute[75260]:     </interface>
Nov 27 04:38:49 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:38:49 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/console.log" append="off"/>
Nov 27 04:38:49 user nova-compute[75260]:     </serial>
Nov 27 04:38:49 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:38:49 user nova-compute[75260]:     <video>
Nov 27 04:38:49 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:38:49 user nova-compute[75260]:     </video>
Nov 27 04:38:49 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:38:49 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:38:49 user nova-compute[75260]:     </rng>
Nov 27 04:38:49 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:38:49 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:38:49 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:38:49 user nova-compute[75260]:     </memballoon>
Nov 27 04:38:49 user nova-compute[75260]:   </devices>
Nov 27 04:38:49 user nova-compute[75260]: </domain>
Nov 27 04:38:49 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-802958880',display_name='tempest-ServerRescueNegativeTestJSON-server-802958880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-802958880',id=2,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-hpfh43sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:45Z,user_data=None,user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=d8cd1732-d408-4ef3-85b6-94b12ba7f5ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:85:32,bridge_name='br-int',has_traffic_filtering=True,id=3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9a12f-82') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG os_vif [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:85:32,bridge_name='br-int',has_traffic_filtering=True,id=3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9a12f-82') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5030bddf-0eef-540c-8c01-03a406b98c52', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:38:50 user nova-compute[75260]: DEBUG nova.network.neutron [req-a38220d8-c13c-4e26-a8ce-ce9253031611 req-f146d8d1-a666-4813-ba0a-4a69ca03e783 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updated VIF entry in instance network info cache for port 240c5141-ac9c-45d3-ba42-5e854ceee9ed. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:38:50 user nova-compute[75260]: DEBUG nova.network.neutron [req-a38220d8-c13c-4e26-a8ce-ce9253031611 req-f146d8d1-a666-4813-ba0a-4a69ca03e783 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updating instance_info_cache with network_info: [{"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:38:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a38220d8-c13c-4e26-a8ce-ce9253031611 req-f146d8d1-a666-4813-ba0a-4a69ca03e783 service nova] Releasing lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:38:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-ca02431b-5f21-41a9-a906-727a6669d925 req-d43f7579-d45a-41fe-8d79-436eddd394a3 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-changed-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:38:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-ca02431b-5f21-41a9-a906-727a6669d925 req-d43f7579-d45a-41fe-8d79-436eddd394a3 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Refreshing instance network info cache due to event network-changed-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:38:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ca02431b-5f21-41a9-a906-727a6669d925 req-d43f7579-d45a-41fe-8d79-436eddd394a3 service nova] Acquiring lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:38:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ca02431b-5f21-41a9-a906-727a6669d925 req-d43f7579-d45a-41fe-8d79-436eddd394a3 service nova] Acquired lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:38:50 user nova-compute[75260]: DEBUG nova.network.neutron [req-ca02431b-5f21-41a9-a906-727a6669d925 req-d43f7579-d45a-41fe-8d79-436eddd394a3 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Refreshing network info cache for port 3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:38:50 user sudo[84550]: pam_unix(sudo:session): session closed for user root
Nov 27 04:38:51 user nova-compute[75260]: INFO oslo.privsep.daemon [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Spawned new privsep daemon via rootwrap
Nov 27 04:38:51 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 27 04:38:51 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 27 04:38:51 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 27 04:38:51 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84553
Nov 27 04:38:51 user nova-compute[75260]: WARNING oslo_privsep.priv_context [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] privsep daemon already running
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap240c5141-ac, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap240c5141-ac, col_values=(('qos', UUID('a63ce9c3-b5c6-4d87-90e0-b4ecabe55265')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap240c5141-ac, col_values=(('external_ids', {'iface-id': '240c5141-ac9c-45d3-ba42-5e854ceee9ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:25:f7', 'vm-uuid': '7c01d799-540f-469b-8417-5af70d803adf'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:51 user nova-compute[75260]: INFO os_vif [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:25:f7,bridge_name='br-int',has_traffic_filtering=True,id=240c5141-ac9c-45d3-ba42-5e854ceee9ed,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240c5141-ac')
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ba9a12f-82, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ba9a12f-82, col_values=(('qos', UUID('54d517b9-1e65-420c-b62e-a593f7229a99')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ba9a12f-82, col_values=(('external_ids', {'iface-id': '3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:85:32', 'vm-uuid': 'd8cd1732-d408-4ef3-85b6-94b12ba7f5ad'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:51 user nova-compute[75260]: INFO os_vif [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:85:32,bridge_name='br-int',has_traffic_filtering=True,id=3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9a12f-82')
Nov 27 04:38:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No VIF found with MAC fa:16:3e:a5:25:f7, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No VIF found with MAC fa:16:3e:b1:85:32, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:38:52 user nova-compute[75260]: INFO nova.compute.claims [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Claim successful on node user
Nov 27 04:38:52 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:38:52 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:38:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:38:52 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Creating image(s)
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "/opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "/opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "/opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.policy [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cbd63730ab84fa3aa9a05b06194ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8a8bd85b234d8e82487ead1232a644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk 1073741824" returned: 0 in 0.060s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-ca02431b-5f21-41a9-a906-727a6669d925 req-d43f7579-d45a-41fe-8d79-436eddd394a3 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updated VIF entry in instance network info cache for port 3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-ca02431b-5f21-41a9-a906-727a6669d925 req-d43f7579-d45a-41fe-8d79-436eddd394a3 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updating instance_info_cache with network_info: [{"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ca02431b-5f21-41a9-a906-727a6669d925 req-d43f7579-d45a-41fe-8d79-436eddd394a3 service nova] Releasing lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:38:53 user nova-compute[75260]: INFO nova.compute.claims [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Claim successful on node user
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Cannot resize image /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Ensure instance console log exists: /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:38:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:38:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:38:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Creating image(s)
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "/opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "/opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "/opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.216s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG nova.policy [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1b9f31e8cfe433ba6988d8be95ff00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a01c78567be4d4ca62fd53ad2937ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk 1073741824" returned: 0 in 0.070s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.167s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Cannot resize image /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Ensure instance console log exists: /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-628e4d27-056d-4374-acf5-98ecefd884f6 req-d8de4760-0f2b-4a43-be2e-8f723713bb8a service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-628e4d27-056d-4374-acf5-98ecefd884f6 req-d8de4760-0f2b-4a43-be2e-8f723713bb8a service nova] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-628e4d27-056d-4374-acf5-98ecefd884f6 req-d8de4760-0f2b-4a43-be2e-8f723713bb8a service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-628e4d27-056d-4374-acf5-98ecefd884f6 req-d8de4760-0f2b-4a43-be2e-8f723713bb8a service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-628e4d27-056d-4374-acf5-98ecefd884f6 req-d8de4760-0f2b-4a43-be2e-8f723713bb8a service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] No waiting events found dispatching network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:38:56 user nova-compute[75260]: WARNING nova.compute.manager [req-628e4d27-056d-4374-acf5-98ecefd884f6 req-d8de4760-0f2b-4a43-be2e-8f723713bb8a service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received unexpected event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e for instance with vm_state building and task_state spawning.
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:38:56 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Instance spawned successfully.
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:38:56 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Instance spawned successfully.
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:38:56 user nova-compute[75260]: INFO nova.compute.manager [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Took 11.77 seconds to spawn the instance on the hypervisor.
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:38:56 user nova-compute[75260]: INFO nova.compute.manager [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Took 13.79 seconds to spawn the instance on the hypervisor.
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:38:56 user nova-compute[75260]: INFO nova.compute.manager [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Took 14.98 seconds to build instance.
Nov 27 04:38:56 user nova-compute[75260]: INFO nova.compute.manager [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Took 12.64 seconds to build instance.
Nov 27 04:38:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8afc1f58-ca5f-4bbf-b330-082f65dc9d6b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "7c01d799-540f-469b-8417-5af70d803adf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.162s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-272672a1-64ae-4ece-9ff8-6d16aa62484c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.826s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:38:56 user nova-compute[75260]: INFO nova.compute.claims [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Claim successful on node user
Nov 27 04:38:57 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:38:57 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:38:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.783s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:38:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:38:57 user nova-compute[75260]: DEBUG nova.network.neutron [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:38:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:38:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:38:57 user nova-compute[75260]: DEBUG nova.network.neutron [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Successfully created port: e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:38:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Creating image(s)
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "/opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "/opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG nova.policy [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a14d60620b674141a4f714eac61c29d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd8fd68d8c94c95908b4cd7c80082d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.218s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-18477719-37d0-4540-9857-c4799eb911e4 req-901766e3-856a-4b17-b1b5-1a4f0d6c5588 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-18477719-37d0-4540-9857-c4799eb911e4 req-901766e3-856a-4b17-b1b5-1a4f0d6c5588 service nova] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-18477719-37d0-4540-9857-c4799eb911e4 req-901766e3-856a-4b17-b1b5-1a4f0d6c5588 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-18477719-37d0-4540-9857-c4799eb911e4 req-901766e3-856a-4b17-b1b5-1a4f0d6c5588 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-18477719-37d0-4540-9857-c4799eb911e4 req-901766e3-856a-4b17-b1b5-1a4f0d6c5588 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] No waiting events found dispatching network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:38:58 user nova-compute[75260]: WARNING nova.compute.manager [req-18477719-37d0-4540-9857-c4799eb911e4 req-901766e3-856a-4b17-b1b5-1a4f0d6c5588 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received unexpected event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e for instance with vm_state active and task_state None.
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.228s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk 1073741824" returned: 0 in 0.076s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.268s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:38:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:38:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:38:59 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Cannot resize image /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:38:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:38:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Ensure instance console log exists: /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:38:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:38:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:38:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:38:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Successfully created port: f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "cd971ad8-53b2-4088-9133-862ab89dc27e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:39:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:39:00 user nova-compute[75260]: INFO nova.compute.claims [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Claim successful on node user
Nov 27 04:39:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Successfully created port: 6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:39:01 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:39:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG nova.policy [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87cf690bdffe48d39b62bf09cca81d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deff7f2657d442a89aa29b3de5e9680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:39:01 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Creating image(s)
Nov 27 04:39:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "/opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "/opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.304s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Successfully updated port: 6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.235s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquired lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk 1073741824" returned: 0 in 0.080s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.249s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Successfully updated port: e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquired lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-8a5aea2d-b8b1-48c5-acb4-86dd14e64b25 req-313f1259-cbd4-4174-adf6-e99cc461748b service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-changed-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-8a5aea2d-b8b1-48c5-acb4-86dd14e64b25 req-313f1259-cbd4-4174-adf6-e99cc461748b service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Refreshing instance network info cache due to event network-changed-6cb5862a-fc82-4f80-820f-02082def752d. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8a5aea2d-b8b1-48c5-acb4-86dd14e64b25 req-313f1259-cbd4-4174-adf6-e99cc461748b service nova] Acquiring lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-af9562ed-b752-4209-a77f-f09bd9b01aa5 req-99797385-345c-4b57-85e6-032047d49993 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-changed-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-af9562ed-b752-4209-a77f-f09bd9b01aa5 req-99797385-345c-4b57-85e6-032047d49993 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Refreshing instance network info cache due to event network-changed-e07f49c0-b893-44bf-a195-c351eadfe333. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-af9562ed-b752-4209-a77f-f09bd9b01aa5 req-99797385-345c-4b57-85e6-032047d49993 service nova] Acquiring lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Cannot resize image /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Ensure instance console log exists: /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Successfully updated port: f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquired lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating instance_info_cache with network_info: [{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Releasing lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance network_info: |[{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8a5aea2d-b8b1-48c5-acb4-86dd14e64b25 req-313f1259-cbd4-4174-adf6-e99cc461748b service nova] Acquired lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.neutron [req-8a5aea2d-b8b1-48c5-acb4-86dd14e64b25 req-313f1259-cbd4-4174-adf6-e99cc461748b service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Refreshing network info cache for port 6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Start _get_guest_xml network_info=[{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:39:03 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:03 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1986422466',display_name='tempest-ServerActionsTestOtherB-server-1986422466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1986422466',id=5,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFB4NlyIkvuSkKdp9SCBvCksg0T5Mnmhzu1gg97fKizA6KbOPtAhyX+dbdgThddRNEEVcx1W9A9Raajm8WlZrhxaZj1ByekP4XOJKsLxLKWygxJTACdG4AQr3SivYfkcQ==',key_name='tempest-keypair-1211691950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dd8fd68d8c94c95908b4cd7c80082d5',ramdisk_id='',reservation_id='r-sfca6us3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1382636293',owner_user_name='tempest-ServerActionsTestOtherB-1382636293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a14d60620b674141a4f714eac61c29d5',uuid=3d96ab7b-3690-424e-96da-5e69b1bb1e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converting VIF {"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.objects.instance [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d96ab7b-3690-424e-96da-5e69b1bb1e90 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:39:03 user nova-compute[75260]:   <uuid>3d96ab7b-3690-424e-96da-5e69b1bb1e90</uuid>
Nov 27 04:39:03 user nova-compute[75260]:   <name>instance-00000005</name>
Nov 27 04:39:03 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:39:03 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:39:03 user nova-compute[75260]:   <metadata>
Nov 27 04:39:03 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:39:03 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:39:03 user nova-compute[75260]:       <nova:name>tempest-ServerActionsTestOtherB-server-1986422466</nova:name>
Nov 27 04:39:03 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:39:03</nova:creationTime>
Nov 27 04:39:03 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:39:03 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:39:03 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:39:03 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:39:03 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:39:03 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:39:03 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:39:03 user nova-compute[75260]:       <nova:owner>
Nov 27 04:39:03 user nova-compute[75260]:         <nova:user uuid="a14d60620b674141a4f714eac61c29d5">tempest-ServerActionsTestOtherB-1382636293-project-member</nova:user>
Nov 27 04:39:03 user nova-compute[75260]:         <nova:project uuid="2dd8fd68d8c94c95908b4cd7c80082d5">tempest-ServerActionsTestOtherB-1382636293</nova:project>
Nov 27 04:39:03 user nova-compute[75260]:       </nova:owner>
Nov 27 04:39:03 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:39:03 user nova-compute[75260]:       <nova:ports>
Nov 27 04:39:03 user nova-compute[75260]:         <nova:port uuid="6cb5862a-fc82-4f80-820f-02082def752d">
Nov 27 04:39:03 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 04:39:03 user nova-compute[75260]:         </nova:port>
Nov 27 04:39:03 user nova-compute[75260]:       </nova:ports>
Nov 27 04:39:03 user nova-compute[75260]:     </nova:instance>
Nov 27 04:39:03 user nova-compute[75260]:   </metadata>
Nov 27 04:39:03 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:39:03 user nova-compute[75260]:     <system>
Nov 27 04:39:03 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:39:03 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:39:03 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:39:03 user nova-compute[75260]:       <entry name="serial">3d96ab7b-3690-424e-96da-5e69b1bb1e90</entry>
Nov 27 04:39:03 user nova-compute[75260]:       <entry name="uuid">3d96ab7b-3690-424e-96da-5e69b1bb1e90</entry>
Nov 27 04:39:03 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:39:03 user nova-compute[75260]:     </system>
Nov 27 04:39:03 user nova-compute[75260]:   </sysinfo>
Nov 27 04:39:03 user nova-compute[75260]:   <os>
Nov 27 04:39:03 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:39:03 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:39:03 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:39:03 user nova-compute[75260]:   </os>
Nov 27 04:39:03 user nova-compute[75260]:   <features>
Nov 27 04:39:03 user nova-compute[75260]:     <acpi/>
Nov 27 04:39:03 user nova-compute[75260]:     <apic/>
Nov 27 04:39:03 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:39:03 user nova-compute[75260]:   </features>
Nov 27 04:39:03 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:39:03 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:39:03 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:39:03 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:39:03 user nova-compute[75260]:   </clock>
Nov 27 04:39:03 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:39:03 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:39:03 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:39:03 user nova-compute[75260]:   </cpu>
Nov 27 04:39:03 user nova-compute[75260]:   <devices>
Nov 27 04:39:03 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:39:03 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:39:03 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk"/>
Nov 27 04:39:03 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:39:03 user nova-compute[75260]:     </disk>
Nov 27 04:39:03 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:39:03 user nova-compute[75260]:       <mac address="fa:16:3e:aa:95:ab"/>
Nov 27 04:39:03 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:03 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:39:03 user nova-compute[75260]:       <target dev="tap6cb5862a-fc"/>
Nov 27 04:39:03 user nova-compute[75260]:     </interface>
Nov 27 04:39:03 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:39:03 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/console.log" append="off"/>
Nov 27 04:39:03 user nova-compute[75260]:     </serial>
Nov 27 04:39:03 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:39:03 user nova-compute[75260]:     <video>
Nov 27 04:39:03 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:03 user nova-compute[75260]:     </video>
Nov 27 04:39:03 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:39:03 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:39:03 user nova-compute[75260]:     </rng>
Nov 27 04:39:03 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:39:03 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:39:03 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:39:03 user nova-compute[75260]:     </memballoon>
Nov 27 04:39:03 user nova-compute[75260]:   </devices>
Nov 27 04:39:03 user nova-compute[75260]: </domain>
Nov 27 04:39:03 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1986422466',display_name='tempest-ServerActionsTestOtherB-server-1986422466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1986422466',id=5,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFB4NlyIkvuSkKdp9SCBvCksg0T5Mnmhzu1gg97fKizA6KbOPtAhyX+dbdgThddRNEEVcx1W9A9Raajm8WlZrhxaZj1ByekP4XOJKsLxLKWygxJTACdG4AQr3SivYfkcQ==',key_name='tempest-keypair-1211691950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dd8fd68d8c94c95908b4cd7c80082d5',ramdisk_id='',reservation_id='r-sfca6us3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1382636293',owner_user_name='tempest-ServerActionsTestOtherB-1382636293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a14d60620b674141a4f714eac61c29d5',uuid=3d96ab7b-3690-424e-96da-5e69b1bb1e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converting VIF {"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG os_vif [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9076afbe-9d15-54b9-907f-abfa4e0b995b', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cb5862a-fc, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cb5862a-fc, col_values=(('qos', UUID('7a017b0c-d2c9-4b18-bb4d-4ad8df553285')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cb5862a-fc, col_values=(('external_ids', {'iface-id': '6cb5862a-fc82-4f80-820f-02082def752d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:95:ab', 'vm-uuid': '3d96ab7b-3690-424e-96da-5e69b1bb1e90'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:03 user nova-compute[75260]: INFO os_vif [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc')
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updating instance_info_cache with network_info: [{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Successfully created port: cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Releasing lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance network_info: |[{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-af9562ed-b752-4209-a77f-f09bd9b01aa5 req-99797385-345c-4b57-85e6-032047d49993 service nova] Acquired lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.network.neutron [req-af9562ed-b752-4209-a77f-f09bd9b01aa5 req-99797385-345c-4b57-85e6-032047d49993 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Refreshing network info cache for port e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Start _get_guest_xml network_info=[{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:39:04 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:04 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658059163',display_name='tempest-AttachVolumeTestJSON-server-658059163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658059163',id=3,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/GFJ1RKiLPqz1av9ONhStQdrFP19obKkEGU7x+pfBUqsksA5dF6EGjTzeKbXRH4TNzkcH/co8UJKydluZFyoGJur/nedX5G2Wm9SLqgk6epiltTyDcIWj5HSqtnqbSFA==',key_name='tempest-keypair-531623201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-4gzgeom6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=12efb820-12ab-442d-a5fe-80b08f12a729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.objects.instance [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'pci_devices' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] No VIF found with MAC fa:16:3e:aa:95:ab, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:39:04 user nova-compute[75260]:   <uuid>12efb820-12ab-442d-a5fe-80b08f12a729</uuid>
Nov 27 04:39:04 user nova-compute[75260]:   <name>instance-00000003</name>
Nov 27 04:39:04 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:39:04 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:39:04 user nova-compute[75260]:   <metadata>
Nov 27 04:39:04 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:39:04 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:39:04 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeTestJSON-server-658059163</nova:name>
Nov 27 04:39:04 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:39:04</nova:creationTime>
Nov 27 04:39:04 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:39:04 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:39:04 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:39:04 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:39:04 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:39:04 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:39:04 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:39:04 user nova-compute[75260]:       <nova:owner>
Nov 27 04:39:04 user nova-compute[75260]:         <nova:user uuid="1cbd63730ab84fa3aa9a05b06194ad4a">tempest-AttachVolumeTestJSON-2145472694-project-member</nova:user>
Nov 27 04:39:04 user nova-compute[75260]:         <nova:project uuid="ea8a8bd85b234d8e82487ead1232a644">tempest-AttachVolumeTestJSON-2145472694</nova:project>
Nov 27 04:39:04 user nova-compute[75260]:       </nova:owner>
Nov 27 04:39:04 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:39:04 user nova-compute[75260]:       <nova:ports>
Nov 27 04:39:04 user nova-compute[75260]:         <nova:port uuid="e07f49c0-b893-44bf-a195-c351eadfe333">
Nov 27 04:39:04 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 04:39:04 user nova-compute[75260]:         </nova:port>
Nov 27 04:39:04 user nova-compute[75260]:       </nova:ports>
Nov 27 04:39:04 user nova-compute[75260]:     </nova:instance>
Nov 27 04:39:04 user nova-compute[75260]:   </metadata>
Nov 27 04:39:04 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:39:04 user nova-compute[75260]:     <system>
Nov 27 04:39:04 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:39:04 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:39:04 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:39:04 user nova-compute[75260]:       <entry name="serial">12efb820-12ab-442d-a5fe-80b08f12a729</entry>
Nov 27 04:39:04 user nova-compute[75260]:       <entry name="uuid">12efb820-12ab-442d-a5fe-80b08f12a729</entry>
Nov 27 04:39:04 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:39:04 user nova-compute[75260]:     </system>
Nov 27 04:39:04 user nova-compute[75260]:   </sysinfo>
Nov 27 04:39:04 user nova-compute[75260]:   <os>
Nov 27 04:39:04 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:39:04 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:39:04 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:39:04 user nova-compute[75260]:   </os>
Nov 27 04:39:04 user nova-compute[75260]:   <features>
Nov 27 04:39:04 user nova-compute[75260]:     <acpi/>
Nov 27 04:39:04 user nova-compute[75260]:     <apic/>
Nov 27 04:39:04 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:39:04 user nova-compute[75260]:   </features>
Nov 27 04:39:04 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:39:04 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:39:04 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:39:04 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:39:04 user nova-compute[75260]:   </clock>
Nov 27 04:39:04 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:39:04 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:39:04 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:39:04 user nova-compute[75260]:   </cpu>
Nov 27 04:39:04 user nova-compute[75260]:   <devices>
Nov 27 04:39:04 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:39:04 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:39:04 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk"/>
Nov 27 04:39:04 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:39:04 user nova-compute[75260]:     </disk>
Nov 27 04:39:04 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:39:04 user nova-compute[75260]:       <mac address="fa:16:3e:7e:e4:1f"/>
Nov 27 04:39:04 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:04 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:39:04 user nova-compute[75260]:       <target dev="tape07f49c0-b8"/>
Nov 27 04:39:04 user nova-compute[75260]:     </interface>
Nov 27 04:39:04 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:39:04 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/console.log" append="off"/>
Nov 27 04:39:04 user nova-compute[75260]:     </serial>
Nov 27 04:39:04 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:39:04 user nova-compute[75260]:     <video>
Nov 27 04:39:04 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:04 user nova-compute[75260]:     </video>
Nov 27 04:39:04 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:39:04 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:39:04 user nova-compute[75260]:     </rng>
Nov 27 04:39:04 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:39:04 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:39:04 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:39:04 user nova-compute[75260]:     </memballoon>
Nov 27 04:39:04 user nova-compute[75260]:   </devices>
Nov 27 04:39:04 user nova-compute[75260]: </domain>
Nov 27 04:39:04 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658059163',display_name='tempest-AttachVolumeTestJSON-server-658059163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658059163',id=3,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/GFJ1RKiLPqz1av9ONhStQdrFP19obKkEGU7x+pfBUqsksA5dF6EGjTzeKbXRH4TNzkcH/co8UJKydluZFyoGJur/nedX5G2Wm9SLqgk6epiltTyDcIWj5HSqtnqbSFA==',key_name='tempest-keypair-531623201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-4gzgeom6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=12efb820-12ab-442d-a5fe-80b08f12a729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG os_vif [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '914d8451-7e13-5606-b344-cbb7df8842a4', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape07f49c0-b8, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape07f49c0-b8, col_values=(('qos', UUID('a6d64040-711b-4719-bd4e-f6b8647c0923')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape07f49c0-b8, col_values=(('external_ids', {'iface-id': 'e07f49c0-b893-44bf-a195-c351eadfe333', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:e4:1f', 'vm-uuid': '12efb820-12ab-442d-a5fe-80b08f12a729'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:04 user nova-compute[75260]: INFO os_vif [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8')
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No VIF found with MAC fa:16:3e:7e:e4:1f, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-8d58ca93-df6b-4584-bd95-8aed5420b195 req-bc40f70a-e666-4599-8985-ef8a7a3c7369 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received event network-changed-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-8d58ca93-df6b-4584-bd95-8aed5420b195 req-bc40f70a-e666-4599-8985-ef8a7a3c7369 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Refreshing instance network info cache due to event network-changed-f74f921d-51d0-49a1-8cc0-4bf793bec0e3. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8d58ca93-df6b-4584-bd95-8aed5420b195 req-bc40f70a-e666-4599-8985-ef8a7a3c7369 service nova] Acquiring lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.network.neutron [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Updating instance_info_cache with network_info: [{"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-8a5aea2d-b8b1-48c5-acb4-86dd14e64b25 req-313f1259-cbd4-4174-adf6-e99cc461748b service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updated VIF entry in instance network info cache for port 6cb5862a-fc82-4f80-820f-02082def752d. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-8a5aea2d-b8b1-48c5-acb4-86dd14e64b25 req-313f1259-cbd4-4174-adf6-e99cc461748b service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating instance_info_cache with network_info: [{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Releasing lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Instance network_info: |[{"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8d58ca93-df6b-4584-bd95-8aed5420b195 req-bc40f70a-e666-4599-8985-ef8a7a3c7369 service nova] Acquired lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-8d58ca93-df6b-4584-bd95-8aed5420b195 req-bc40f70a-e666-4599-8985-ef8a7a3c7369 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Refreshing network info cache for port f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Start _get_guest_xml network_info=[{"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8a5aea2d-b8b1-48c5-acb4-86dd14e64b25 req-313f1259-cbd4-4174-adf6-e99cc461748b service nova] Releasing lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:04 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:04 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:39:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-629624880',display_name='tempest-AttachVolumeNegativeTest-server-629624880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-629624880',id=4,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBNnwS+ZrEpcayLlQ4+RI6RmiM+4kNlo2w22NYcBE4oJ8s5NPncK/OogGnP9uynN/QUv9PCf+eieULxLLUOM/r9vw4IID2KKQ6YXLv/OqlPe4yeDLddmDfJZ4soe0BoGw==',key_name='tempest-keypair-367679512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-4gsqrqw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=d47665e4-157a-46e2-85a3-1c5cde99db1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:01:39,bridge_name='br-int',has_traffic_filtering=True,id=f74f921d-51d0-49a1-8cc0-4bf793bec0e3,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74f921d-51') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.objects.instance [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'pci_devices' on Instance uuid d47665e4-157a-46e2-85a3-1c5cde99db1a {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:39:05 user nova-compute[75260]:   <uuid>d47665e4-157a-46e2-85a3-1c5cde99db1a</uuid>
Nov 27 04:39:05 user nova-compute[75260]:   <name>instance-00000004</name>
Nov 27 04:39:05 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:39:05 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:39:05 user nova-compute[75260]:   <metadata>
Nov 27 04:39:05 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:39:05 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:39:05 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeNegativeTest-server-629624880</nova:name>
Nov 27 04:39:05 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:39:04</nova:creationTime>
Nov 27 04:39:05 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:39:05 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:39:05 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:39:05 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:39:05 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:39:05 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:39:05 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:39:05 user nova-compute[75260]:       <nova:owner>
Nov 27 04:39:05 user nova-compute[75260]:         <nova:user uuid="a1b9f31e8cfe433ba6988d8be95ff00c">tempest-AttachVolumeNegativeTest-1561165574-project-member</nova:user>
Nov 27 04:39:05 user nova-compute[75260]:         <nova:project uuid="1a01c78567be4d4ca62fd53ad2937ff5">tempest-AttachVolumeNegativeTest-1561165574</nova:project>
Nov 27 04:39:05 user nova-compute[75260]:       </nova:owner>
Nov 27 04:39:05 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:39:05 user nova-compute[75260]:       <nova:ports>
Nov 27 04:39:05 user nova-compute[75260]:         <nova:port uuid="f74f921d-51d0-49a1-8cc0-4bf793bec0e3">
Nov 27 04:39:05 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 04:39:05 user nova-compute[75260]:         </nova:port>
Nov 27 04:39:05 user nova-compute[75260]:       </nova:ports>
Nov 27 04:39:05 user nova-compute[75260]:     </nova:instance>
Nov 27 04:39:05 user nova-compute[75260]:   </metadata>
Nov 27 04:39:05 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:39:05 user nova-compute[75260]:     <system>
Nov 27 04:39:05 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:39:05 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:39:05 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:39:05 user nova-compute[75260]:       <entry name="serial">d47665e4-157a-46e2-85a3-1c5cde99db1a</entry>
Nov 27 04:39:05 user nova-compute[75260]:       <entry name="uuid">d47665e4-157a-46e2-85a3-1c5cde99db1a</entry>
Nov 27 04:39:05 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:39:05 user nova-compute[75260]:     </system>
Nov 27 04:39:05 user nova-compute[75260]:   </sysinfo>
Nov 27 04:39:05 user nova-compute[75260]:   <os>
Nov 27 04:39:05 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:39:05 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:39:05 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:39:05 user nova-compute[75260]:   </os>
Nov 27 04:39:05 user nova-compute[75260]:   <features>
Nov 27 04:39:05 user nova-compute[75260]:     <acpi/>
Nov 27 04:39:05 user nova-compute[75260]:     <apic/>
Nov 27 04:39:05 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:39:05 user nova-compute[75260]:   </features>
Nov 27 04:39:05 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:39:05 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:39:05 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:39:05 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:39:05 user nova-compute[75260]:   </clock>
Nov 27 04:39:05 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:39:05 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:39:05 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:39:05 user nova-compute[75260]:   </cpu>
Nov 27 04:39:05 user nova-compute[75260]:   <devices>
Nov 27 04:39:05 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:39:05 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:39:05 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk"/>
Nov 27 04:39:05 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:39:05 user nova-compute[75260]:     </disk>
Nov 27 04:39:05 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:39:05 user nova-compute[75260]:       <mac address="fa:16:3e:d1:01:39"/>
Nov 27 04:39:05 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:05 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:39:05 user nova-compute[75260]:       <target dev="tapf74f921d-51"/>
Nov 27 04:39:05 user nova-compute[75260]:     </interface>
Nov 27 04:39:05 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:39:05 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/console.log" append="off"/>
Nov 27 04:39:05 user nova-compute[75260]:     </serial>
Nov 27 04:39:05 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:39:05 user nova-compute[75260]:     <video>
Nov 27 04:39:05 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:05 user nova-compute[75260]:     </video>
Nov 27 04:39:05 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:39:05 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:39:05 user nova-compute[75260]:     </rng>
Nov 27 04:39:05 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:39:05 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:39:05 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:39:05 user nova-compute[75260]:     </memballoon>
Nov 27 04:39:05 user nova-compute[75260]:   </devices>
Nov 27 04:39:05 user nova-compute[75260]: </domain>
Nov 27 04:39:05 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-629624880',display_name='tempest-AttachVolumeNegativeTest-server-629624880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-629624880',id=4,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBNnwS+ZrEpcayLlQ4+RI6RmiM+4kNlo2w22NYcBE4oJ8s5NPncK/OogGnP9uynN/QUv9PCf+eieULxLLUOM/r9vw4IID2KKQ6YXLv/OqlPe4yeDLddmDfJZ4soe0BoGw==',key_name='tempest-keypair-367679512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-4gsqrqw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=d47665e4-157a-46e2-85a3-1c5cde99db1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:01:39,bridge_name='br-int',has_traffic_filtering=True,id=f74f921d-51d0-49a1-8cc0-4bf793bec0e3,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74f921d-51') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG os_vif [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:01:39,bridge_name='br-int',has_traffic_filtering=True,id=f74f921d-51d0-49a1-8cc0-4bf793bec0e3,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74f921d-51') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11451950-5100-58be-8084-b2728e9a111e', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf74f921d-51, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf74f921d-51, col_values=(('qos', UUID('6e04685a-c2b3-4e1d-a571-2edfaa8334aa')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf74f921d-51, col_values=(('external_ids', {'iface-id': 'f74f921d-51d0-49a1-8cc0-4bf793bec0e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:01:39', 'vm-uuid': 'd47665e4-157a-46e2-85a3-1c5cde99db1a'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:05 user nova-compute[75260]: INFO os_vif [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:01:39,bridge_name='br-int',has_traffic_filtering=True,id=f74f921d-51d0-49a1-8cc0-4bf793bec0e3,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74f921d-51')
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No VIF found with MAC fa:16:3e:d1:01:39, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.network.neutron [req-af9562ed-b752-4209-a77f-f09bd9b01aa5 req-99797385-345c-4b57-85e6-032047d49993 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updated VIF entry in instance network info cache for port e07f49c0-b893-44bf-a195-c351eadfe333. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.network.neutron [req-af9562ed-b752-4209-a77f-f09bd9b01aa5 req-99797385-345c-4b57-85e6-032047d49993 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updating instance_info_cache with network_info: [{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-af9562ed-b752-4209-a77f-f09bd9b01aa5 req-99797385-345c-4b57-85e6-032047d49993 service nova] Releasing lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Successfully updated port: cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquired lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.compute.manager [req-02e01316-0386-4ef1-9ad3-4ddd9f8bd7dc req-3b205ba8-3240-4d2c-af7a-666dfff0d8e4 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received event network-changed-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG nova.compute.manager [req-02e01316-0386-4ef1-9ad3-4ddd9f8bd7dc req-3b205ba8-3240-4d2c-af7a-666dfff0d8e4 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Refreshing instance network info cache due to event network-changed-cc9f1b45-41d8-4d4c-9396-d9ac528d5783. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-02e01316-0386-4ef1-9ad3-4ddd9f8bd7dc req-3b205ba8-3240-4d2c-af7a-666dfff0d8e4 service nova] Acquiring lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Updating instance_info_cache with network_info: [{"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.network.neutron [req-8d58ca93-df6b-4584-bd95-8aed5420b195 req-bc40f70a-e666-4599-8985-ef8a7a3c7369 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Updated VIF entry in instance network info cache for port f74f921d-51d0-49a1-8cc0-4bf793bec0e3. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.network.neutron [req-8d58ca93-df6b-4584-bd95-8aed5420b195 req-bc40f70a-e666-4599-8985-ef8a7a3c7369 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Updating instance_info_cache with network_info: [{"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8d58ca93-df6b-4584-bd95-8aed5420b195 req-bc40f70a-e666-4599-8985-ef8a7a3c7369 service nova] Releasing lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Releasing lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Instance network_info: |[{"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-02e01316-0386-4ef1-9ad3-4ddd9f8bd7dc req-3b205ba8-3240-4d2c-af7a-666dfff0d8e4 service nova] Acquired lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.network.neutron [req-02e01316-0386-4ef1-9ad3-4ddd9f8bd7dc req-3b205ba8-3240-4d2c-af7a-666dfff0d8e4 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Refreshing network info cache for port cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Start _get_guest_xml network_info=[{"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:39:06 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:06 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1417631610',display_name='tempest-VolumesAdminNegativeTest-server-1417631610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1417631610',id=6,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW9HC3uVolTWgWjH6HjSihVmqrafAok3qok5pFPymX7ZWyC1VRK5oqiRdezdUEwRr7eBqOsT0H4Ugk0NNXWBVInhTe+2yNJylgnjDYJEOHfbsKC5kL/hUngfFFar/0FOg==',key_name='tempest-keypair-7806836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deff7f2657d442a89aa29b3de5e9680c',ramdisk_id='',reservation_id='r-yz5mre2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-494319220',owner_user_name='tempest-VolumesAdminNegativeTest-494319220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87cf690bdffe48d39b62bf09cca81d90',uuid=cd971ad8-53b2-4088-9133-862ab89dc27e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converting VIF {"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:93:63,bridge_name='br-int',has_traffic_filtering=True,id=cc9f1b45-41d8-4d4c-9396-d9ac528d5783,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9f1b45-41') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.objects.instance [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lazy-loading 'pci_devices' on Instance uuid cd971ad8-53b2-4088-9133-862ab89dc27e {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:39:06 user nova-compute[75260]:   <uuid>cd971ad8-53b2-4088-9133-862ab89dc27e</uuid>
Nov 27 04:39:06 user nova-compute[75260]:   <name>instance-00000006</name>
Nov 27 04:39:06 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:39:06 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:39:06 user nova-compute[75260]:   <metadata>
Nov 27 04:39:06 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:39:06 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:39:06 user nova-compute[75260]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1417631610</nova:name>
Nov 27 04:39:06 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:39:06</nova:creationTime>
Nov 27 04:39:06 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:39:06 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:39:06 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:39:06 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:39:06 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:39:06 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:39:06 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:39:06 user nova-compute[75260]:       <nova:owner>
Nov 27 04:39:06 user nova-compute[75260]:         <nova:user uuid="87cf690bdffe48d39b62bf09cca81d90">tempest-VolumesAdminNegativeTest-494319220-project-member</nova:user>
Nov 27 04:39:06 user nova-compute[75260]:         <nova:project uuid="deff7f2657d442a89aa29b3de5e9680c">tempest-VolumesAdminNegativeTest-494319220</nova:project>
Nov 27 04:39:06 user nova-compute[75260]:       </nova:owner>
Nov 27 04:39:06 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:39:06 user nova-compute[75260]:       <nova:ports>
Nov 27 04:39:06 user nova-compute[75260]:         <nova:port uuid="cc9f1b45-41d8-4d4c-9396-d9ac528d5783">
Nov 27 04:39:06 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:39:06 user nova-compute[75260]:         </nova:port>
Nov 27 04:39:06 user nova-compute[75260]:       </nova:ports>
Nov 27 04:39:06 user nova-compute[75260]:     </nova:instance>
Nov 27 04:39:06 user nova-compute[75260]:   </metadata>
Nov 27 04:39:06 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:39:06 user nova-compute[75260]:     <system>
Nov 27 04:39:06 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:39:06 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:39:06 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:39:06 user nova-compute[75260]:       <entry name="serial">cd971ad8-53b2-4088-9133-862ab89dc27e</entry>
Nov 27 04:39:06 user nova-compute[75260]:       <entry name="uuid">cd971ad8-53b2-4088-9133-862ab89dc27e</entry>
Nov 27 04:39:06 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:39:06 user nova-compute[75260]:     </system>
Nov 27 04:39:06 user nova-compute[75260]:   </sysinfo>
Nov 27 04:39:06 user nova-compute[75260]:   <os>
Nov 27 04:39:06 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:39:06 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:39:06 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:39:06 user nova-compute[75260]:   </os>
Nov 27 04:39:06 user nova-compute[75260]:   <features>
Nov 27 04:39:06 user nova-compute[75260]:     <acpi/>
Nov 27 04:39:06 user nova-compute[75260]:     <apic/>
Nov 27 04:39:06 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:39:06 user nova-compute[75260]:   </features>
Nov 27 04:39:06 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:39:06 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:39:06 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:39:06 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:39:06 user nova-compute[75260]:   </clock>
Nov 27 04:39:06 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:39:06 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:39:06 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:39:06 user nova-compute[75260]:   </cpu>
Nov 27 04:39:06 user nova-compute[75260]:   <devices>
Nov 27 04:39:06 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:39:06 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:39:06 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk"/>
Nov 27 04:39:06 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:39:06 user nova-compute[75260]:     </disk>
Nov 27 04:39:06 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:39:06 user nova-compute[75260]:       <mac address="fa:16:3e:df:93:63"/>
Nov 27 04:39:06 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:06 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:39:06 user nova-compute[75260]:       <target dev="tapcc9f1b45-41"/>
Nov 27 04:39:06 user nova-compute[75260]:     </interface>
Nov 27 04:39:06 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:39:06 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/console.log" append="off"/>
Nov 27 04:39:06 user nova-compute[75260]:     </serial>
Nov 27 04:39:06 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:39:06 user nova-compute[75260]:     <video>
Nov 27 04:39:06 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:06 user nova-compute[75260]:     </video>
Nov 27 04:39:06 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:39:06 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:39:06 user nova-compute[75260]:     </rng>
Nov 27 04:39:06 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:39:06 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:39:06 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:39:06 user nova-compute[75260]:     </memballoon>
Nov 27 04:39:06 user nova-compute[75260]:   </devices>
Nov 27 04:39:06 user nova-compute[75260]: </domain>
Nov 27 04:39:06 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1417631610',display_name='tempest-VolumesAdminNegativeTest-server-1417631610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1417631610',id=6,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW9HC3uVolTWgWjH6HjSihVmqrafAok3qok5pFPymX7ZWyC1VRK5oqiRdezdUEwRr7eBqOsT0H4Ugk0NNXWBVInhTe+2yNJylgnjDYJEOHfbsKC5kL/hUngfFFar/0FOg==',key_name='tempest-keypair-7806836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deff7f2657d442a89aa29b3de5e9680c',ramdisk_id='',reservation_id='r-yz5mre2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-494319220',owner_user_name='tempest-VolumesAdminNegativeTest-494319220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87cf690bdffe48d39b62bf09cca81d90',uuid=cd971ad8-53b2-4088-9133-862ab89dc27e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converting VIF {"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:93:63,bridge_name='br-int',has_traffic_filtering=True,id=cc9f1b45-41d8-4d4c-9396-d9ac528d5783,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9f1b45-41') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG os_vif [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:93:63,bridge_name='br-int',has_traffic_filtering=True,id=cc9f1b45-41d8-4d4c-9396-d9ac528d5783,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9f1b45-41') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '184022e7-6513-5501-aead-eae39c1ebba1', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc9f1b45-41, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc9f1b45-41, col_values=(('qos', UUID('254c7b22-bb5f-4e6c-9f02-91536003b3c4')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc9f1b45-41, col_values=(('external_ids', {'iface-id': 'cc9f1b45-41d8-4d4c-9396-d9ac528d5783', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:93:63', 'vm-uuid': 'cd971ad8-53b2-4088-9133-862ab89dc27e'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:06 user nova-compute[75260]: INFO os_vif [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:93:63,bridge_name='br-int',has_traffic_filtering=True,id=cc9f1b45-41d8-4d4c-9396-d9ac528d5783,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9f1b45-41')
Nov 27 04:39:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:39:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] No VIF found with MAC fa:16:3e:df:93:63, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:39:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-02e01316-0386-4ef1-9ad3-4ddd9f8bd7dc req-3b205ba8-3240-4d2c-af7a-666dfff0d8e4 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Updated VIF entry in instance network info cache for port cc9f1b45-41d8-4d4c-9396-d9ac528d5783. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:39:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-02e01316-0386-4ef1-9ad3-4ddd9f8bd7dc req-3b205ba8-3240-4d2c-af7a-666dfff0d8e4 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Updating instance_info_cache with network_info: [{"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-02e01316-0386-4ef1-9ad3-4ddd9f8bd7dc req-3b205ba8-3240-4d2c-af7a-666dfff0d8e4 service nova] Releasing lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:39:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:39:12 user nova-compute[75260]: INFO nova.compute.claims [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Claim successful on node user
Nov 27 04:39:13 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG nova.network.neutron [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:39:13 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:39:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG nova.policy [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e81da03a2818445ea39db206249f594a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53df145f6844abaef38dd56dd36141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:39:13 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Creating image(s)
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "/opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "/opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.209s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.219s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk 1073741824" returned: 0 in 0.066s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.network.neutron [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Successfully created port: 98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.204s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance spawned successfully.
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-df6ae9c7-dafa-40d3-8a89-8291b7fe6f80 req-a69079ac-d1e1-494b-8cdb-3583b73718fc service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-df6ae9c7-dafa-40d3-8a89-8291b7fe6f80 req-a69079ac-d1e1-494b-8cdb-3583b73718fc service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-df6ae9c7-dafa-40d3-8a89-8291b7fe6f80 req-a69079ac-d1e1-494b-8cdb-3583b73718fc service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-df6ae9c7-dafa-40d3-8a89-8291b7fe6f80 req-a69079ac-d1e1-494b-8cdb-3583b73718fc service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-df6ae9c7-dafa-40d3-8a89-8291b7fe6f80 req-a69079ac-d1e1-494b-8cdb-3583b73718fc service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:14 user nova-compute[75260]: WARNING nova.compute.manager [req-df6ae9c7-dafa-40d3-8a89-8291b7fe6f80 req-a69079ac-d1e1-494b-8cdb-3583b73718fc service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state active and task_state None.
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance spawned successfully.
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Cannot resize image /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Ensure instance console log exists: /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.compute.manager [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Took 21.87 seconds to spawn the instance on the hypervisor.
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Instance spawned successfully.
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Instance spawned successfully.
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.compute.manager [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Took 16.57 seconds to spawn the instance on the hypervisor.
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.compute.manager [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Took 22.68 seconds to build instance.
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.compute.manager [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Took 13.18 seconds to spawn the instance on the hypervisor.
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6be10e36-0287-400e-99f9-e8c2fb15b7ca tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.842s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.compute.manager [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Took 17.96 seconds to build instance.
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.compute.manager [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Took 20.87 seconds to spawn the instance on the hypervisor.
Nov 27 04:39:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-217e57da-8d24-422b-8f5a-aad8382a0da2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.229s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:14 user nova-compute[75260]: INFO nova.compute.manager [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Took 14.41 seconds to build instance.
Nov 27 04:39:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c7a5fbc2-9683-4e2b-9b1c-ac7a617f1c57 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.585s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:15 user nova-compute[75260]: INFO nova.compute.manager [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Took 21.81 seconds to build instance.
Nov 27 04:39:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-881ddcfb-1c05-40af-8289-9f35a4328660 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.026s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "6d334344-945d-4718-9fa1-1464f6d0dad6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:39:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Successfully updated port: 98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:39:15 user nova-compute[75260]: INFO nova.compute.claims [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Claim successful on node user
Nov 27 04:39:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "refresh_cache-a5543a82-a320-4119-8d6e-0476226d619b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquired lock "refresh_cache-a5543a82-a320-4119-8d6e-0476226d619b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.network.neutron [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:16 user nova-compute[75260]: WARNING nova.compute.manager [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state active and task_state None.
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received event network-changed-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Refreshing instance network info cache due to event network-changed-98fe9246-07fb-4d29-bdb3-46459e0e2303. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] Acquiring lock "refresh_cache-a5543a82-a320-4119-8d6e-0476226d619b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.881s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:39:16 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.network.neutron [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Updating instance_info_cache with network_info: [{"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Releasing lock "refresh_cache-a5543a82-a320-4119-8d6e-0476226d619b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Instance network_info: |[{"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] Acquired lock "refresh_cache-a5543a82-a320-4119-8d6e-0476226d619b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.network.neutron [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Refreshing network info cache for port 98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Start _get_guest_xml network_info=[{"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:39:16 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:16 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:39:16 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:39:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2063690473',display_name='tempest-TestVolumeSwap-server-2063690473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2063690473',id=7,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV7eYYE/k4zvO6ojfXeJUUqXDyjsSauljPPvQw1xp/HLqVSvNNt86kBHQqKoVUQBLgel/xjm4squ/K9b8EeC+kUxQb8MkPAGwBxUnpAzXKwX+01PmO1ehGOAT4JcMHTXw==',key_name='tempest-keypair-1202017415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf53df145f6844abaef38dd56dd36141',ramdisk_id='',reservation_id='r-ksycurcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1829398268',owner_user_name='tempest-TestVolumeSwap-1829398268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81da03a2818445ea39db206249f594a',uuid=a5543a82-a320-4119-8d6e-0476226d619b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Converting VIF {"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:3c:e1,bridge_name='br-int',has_traffic_filtering=True,id=98fe9246-07fb-4d29-bdb3-46459e0e2303,network=Network(c780b17d-c298-4ecd-be85-7d076cebf4cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fe9246-07') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.objects.instance [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lazy-loading 'pci_devices' on Instance uuid a5543a82-a320-4119-8d6e-0476226d619b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.policy [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '953e70264643472d8f691f3a171764c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6328ed7eccf41a4b5a3300302db99f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:39:17 user nova-compute[75260]:   <uuid>a5543a82-a320-4119-8d6e-0476226d619b</uuid>
Nov 27 04:39:17 user nova-compute[75260]:   <name>instance-00000007</name>
Nov 27 04:39:17 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:39:17 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:39:17 user nova-compute[75260]:   <metadata>
Nov 27 04:39:17 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:39:17 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:39:17 user nova-compute[75260]:       <nova:name>tempest-TestVolumeSwap-server-2063690473</nova:name>
Nov 27 04:39:17 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:39:16</nova:creationTime>
Nov 27 04:39:17 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:39:17 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:39:17 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:39:17 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:39:17 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:39:17 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:39:17 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:39:17 user nova-compute[75260]:       <nova:owner>
Nov 27 04:39:17 user nova-compute[75260]:         <nova:user uuid="e81da03a2818445ea39db206249f594a">tempest-TestVolumeSwap-1829398268-project-member</nova:user>
Nov 27 04:39:17 user nova-compute[75260]:         <nova:project uuid="bf53df145f6844abaef38dd56dd36141">tempest-TestVolumeSwap-1829398268</nova:project>
Nov 27 04:39:17 user nova-compute[75260]:       </nova:owner>
Nov 27 04:39:17 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:39:17 user nova-compute[75260]:       <nova:ports>
Nov 27 04:39:17 user nova-compute[75260]:         <nova:port uuid="98fe9246-07fb-4d29-bdb3-46459e0e2303">
Nov 27 04:39:17 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 04:39:17 user nova-compute[75260]:         </nova:port>
Nov 27 04:39:17 user nova-compute[75260]:       </nova:ports>
Nov 27 04:39:17 user nova-compute[75260]:     </nova:instance>
Nov 27 04:39:17 user nova-compute[75260]:   </metadata>
Nov 27 04:39:17 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:39:17 user nova-compute[75260]:     <system>
Nov 27 04:39:17 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:39:17 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:39:17 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:39:17 user nova-compute[75260]:       <entry name="serial">a5543a82-a320-4119-8d6e-0476226d619b</entry>
Nov 27 04:39:17 user nova-compute[75260]:       <entry name="uuid">a5543a82-a320-4119-8d6e-0476226d619b</entry>
Nov 27 04:39:17 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:39:17 user nova-compute[75260]:     </system>
Nov 27 04:39:17 user nova-compute[75260]:   </sysinfo>
Nov 27 04:39:17 user nova-compute[75260]:   <os>
Nov 27 04:39:17 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:39:17 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:39:17 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:39:17 user nova-compute[75260]:   </os>
Nov 27 04:39:17 user nova-compute[75260]:   <features>
Nov 27 04:39:17 user nova-compute[75260]:     <acpi/>
Nov 27 04:39:17 user nova-compute[75260]:     <apic/>
Nov 27 04:39:17 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:39:17 user nova-compute[75260]:   </features>
Nov 27 04:39:17 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:39:17 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:39:17 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:39:17 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:39:17 user nova-compute[75260]:   </clock>
Nov 27 04:39:17 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:39:17 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:39:17 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:39:17 user nova-compute[75260]:   </cpu>
Nov 27 04:39:17 user nova-compute[75260]:   <devices>
Nov 27 04:39:17 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:39:17 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:39:17 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk"/>
Nov 27 04:39:17 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:39:17 user nova-compute[75260]:     </disk>
Nov 27 04:39:17 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:39:17 user nova-compute[75260]:       <mac address="fa:16:3e:a2:3c:e1"/>
Nov 27 04:39:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:17 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:39:17 user nova-compute[75260]:       <target dev="tap98fe9246-07"/>
Nov 27 04:39:17 user nova-compute[75260]:     </interface>
Nov 27 04:39:17 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:39:17 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/console.log" append="off"/>
Nov 27 04:39:17 user nova-compute[75260]:     </serial>
Nov 27 04:39:17 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:39:17 user nova-compute[75260]:     <video>
Nov 27 04:39:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:17 user nova-compute[75260]:     </video>
Nov 27 04:39:17 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:39:17 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:39:17 user nova-compute[75260]:     </rng>
Nov 27 04:39:17 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:39:17 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:39:17 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:39:17 user nova-compute[75260]:     </memballoon>
Nov 27 04:39:17 user nova-compute[75260]:   </devices>
Nov 27 04:39:17 user nova-compute[75260]: </domain>
Nov 27 04:39:17 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:39:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2063690473',display_name='tempest-TestVolumeSwap-server-2063690473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2063690473',id=7,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV7eYYE/k4zvO6ojfXeJUUqXDyjsSauljPPvQw1xp/HLqVSvNNt86kBHQqKoVUQBLgel/xjm4squ/K9b8EeC+kUxQb8MkPAGwBxUnpAzXKwX+01PmO1ehGOAT4JcMHTXw==',key_name='tempest-keypair-1202017415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf53df145f6844abaef38dd56dd36141',ramdisk_id='',reservation_id='r-ksycurcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1829398268',owner_user_name='tempest-TestVolumeSwap-1829398268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81da03a2818445ea39db206249f594a',uuid=a5543a82-a320-4119-8d6e-0476226d619b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Converting VIF {"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:3c:e1,bridge_name='br-int',has_traffic_filtering=True,id=98fe9246-07fb-4d29-bdb3-46459e0e2303,network=Network(c780b17d-c298-4ecd-be85-7d076cebf4cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fe9246-07') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG os_vif [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:3c:e1,bridge_name='br-int',has_traffic_filtering=True,id=98fe9246-07fb-4d29-bdb3-46459e0e2303,network=Network(c780b17d-c298-4ecd-be85-7d076cebf4cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fe9246-07') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '346bcc2a-68d3-55a3-b75d-d5ccde80adaa', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98fe9246-07, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98fe9246-07, col_values=(('qos', UUID('31912f13-fa56-4435-be26-b732b6be7910')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98fe9246-07, col_values=(('external_ids', {'iface-id': '98fe9246-07fb-4d29-bdb3-46459e0e2303', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:3c:e1', 'vm-uuid': 'a5543a82-a320-4119-8d6e-0476226d619b'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:17 user nova-compute[75260]: INFO os_vif [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:3c:e1,bridge_name='br-int',has_traffic_filtering=True,id=98fe9246-07fb-4d29-bdb3-46459e0e2303,network=Network(c780b17d-c298-4ecd-be85-7d076cebf4cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fe9246-07')
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:39:17 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Creating image(s)
Nov 27 04:39:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "/opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "/opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "f0ad97059fa6ccbd2149270bc544a8dd8fd316ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "f0ad97059fa6ccbd2149270bc544a8dd8fd316ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] No VIF found with MAC fa:16:3e:a2:3c:e1, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:39:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec.part --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec.part --force-share --output=json" returned: 0 in 0.275s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG nova.virt.images [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] a69a1da0-dd6e-44ad-a31d-918637711477 was qcow2, converting to raw {{(pid=75260) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec.part /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec.converted {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec.part /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec.converted" returned: 0 in 0.196s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec.converted --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG nova.network.neutron [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Updated VIF entry in instance network info cache for port 98fe9246-07fb-4d29-bdb3-46459e0e2303. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG nova.network.neutron [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Updating instance_info_cache with network_info: [{"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c0a4a1d-a284-47f7-993e-7e816b6e121d req-a01b3530-8a7f-4f86-8643-2573e017b4ed service nova] Releasing lock "refresh_cache-a5543a82-a320-4119-8d6e-0476226d619b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec.converted --force-share --output=json" returned: 0 in 0.229s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "f0ad97059fa6ccbd2149270bc544a8dd8fd316ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.402s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Successfully created port: d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec --force-share --output=json" returned: 0 in 0.238s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "f0ad97059fa6ccbd2149270bc544a8dd8fd316ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "f0ad97059fa6ccbd2149270bc544a8dd8fd316ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec --force-share --output=json" returned: 0 in 0.249s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec,backing_fmt=raw /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec,backing_fmt=raw /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk 1073741824" returned: 0 in 0.088s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "f0ad97059fa6ccbd2149270bc544a8dd8fd316ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec --force-share --output=json" returned: 0 in 0.289s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Cannot resize image /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Ensure instance console log exists: /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Successfully updated port: d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "refresh_cache-6d334344-945d-4718-9fa1-1464f6d0dad6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquired lock "refresh_cache-6d334344-945d-4718-9fa1-1464f6d0dad6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-7c0ebfb1-1a3f-4409-b56d-68046df8d2ac req-2c2ecf5d-3ede-4028-9b64-ea25a62d5437 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received event network-changed-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-7c0ebfb1-1a3f-4409-b56d-68046df8d2ac req-2c2ecf5d-3ede-4028-9b64-ea25a62d5437 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Refreshing instance network info cache due to event network-changed-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7c0ebfb1-1a3f-4409-b56d-68046df8d2ac req-2c2ecf5d-3ede-4028-9b64-ea25a62d5437 service nova] Acquiring lock "refresh_cache-6d334344-945d-4718-9fa1-1464f6d0dad6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Updating instance_info_cache with network_info: [{"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Releasing lock "refresh_cache-6d334344-945d-4718-9fa1-1464f6d0dad6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Instance network_info: |[{"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7c0ebfb1-1a3f-4409-b56d-68046df8d2ac req-2c2ecf5d-3ede-4028-9b64-ea25a62d5437 service nova] Acquired lock "refresh_cache-6d334344-945d-4718-9fa1-1464f6d0dad6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.network.neutron [req-7c0ebfb1-1a3f-4409-b56d-68046df8d2ac req-2c2ecf5d-3ede-4028-9b64-ea25a62d5437 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Refreshing network info cache for port d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Start _get_guest_xml network_info=[{"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:39:08Z,direct_url=<?>,disk_format='qcow2',id=a69a1da0-dd6e-44ad-a31d-918637711477,min_disk=0,min_ram=0,name='',owner='b28a4bdef46645ec8e33aefe05b0b9e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:39:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'scsi', 'boot_index': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a69a1da0-dd6e-44ad-a31d-918637711477'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:39:20 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:20 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:39:08Z,direct_url=<?>,disk_format='qcow2',id=a69a1da0-dd6e-44ad-a31d-918637711477,min_disk=0,min_ram=0,name='',owner='b28a4bdef46645ec8e33aefe05b0b9e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:39:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:39:20 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1714191132',display_name='tempest-AttachSCSIVolumeTestJSON-server-1714191132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1714191132',id=8,image_ref='a69a1da0-dd6e-44ad-a31d-918637711477',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCtlEQRS9bwXkDK7hjRppMZyTnAanbiapdRI+0qmxtizYytIeK4Q7NcxhkaCd+uvqyy8cWDQzvntGvOghzARaRnqEF6pSzD59wDR0EMZ5O1uH6ria3eUJ5T2hv4RFd5VQ==',key_name='tempest-keypair-1613158922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6328ed7eccf41a4b5a3300302db99f5',ramdisk_id='',reservation_id='r-pkdf2dwl',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a69a1da0-dd6e-44ad-a31d-918637711477',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2046705655',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2046705655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='953e70264643472d8f691f3a171764c0',uuid=6d334344-945d-4718-9fa1-1464f6d0dad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Converting VIF {"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:18:61,bridge_name='br-int',has_traffic_filtering=True,id=d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6,network=Network(0f899e3b-4a56-43d6-8c2d-fe9b6b94be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f3da5b-76') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d334344-945d-4718-9fa1-1464f6d0dad6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:39:21 user nova-compute[75260]:   <uuid>6d334344-945d-4718-9fa1-1464f6d0dad6</uuid>
Nov 27 04:39:21 user nova-compute[75260]:   <name>instance-00000008</name>
Nov 27 04:39:21 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:39:21 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:39:21 user nova-compute[75260]:   <metadata>
Nov 27 04:39:21 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:39:21 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:39:21 user nova-compute[75260]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1714191132</nova:name>
Nov 27 04:39:21 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:39:20</nova:creationTime>
Nov 27 04:39:21 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:39:21 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:39:21 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:39:21 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:39:21 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:39:21 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:39:21 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:39:21 user nova-compute[75260]:       <nova:owner>
Nov 27 04:39:21 user nova-compute[75260]:         <nova:user uuid="953e70264643472d8f691f3a171764c0">tempest-AttachSCSIVolumeTestJSON-2046705655-project-member</nova:user>
Nov 27 04:39:21 user nova-compute[75260]:         <nova:project uuid="e6328ed7eccf41a4b5a3300302db99f5">tempest-AttachSCSIVolumeTestJSON-2046705655</nova:project>
Nov 27 04:39:21 user nova-compute[75260]:       </nova:owner>
Nov 27 04:39:21 user nova-compute[75260]:       <nova:root type="image" uuid="a69a1da0-dd6e-44ad-a31d-918637711477"/>
Nov 27 04:39:21 user nova-compute[75260]:       <nova:ports>
Nov 27 04:39:21 user nova-compute[75260]:         <nova:port uuid="d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6">
Nov 27 04:39:21 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 04:39:21 user nova-compute[75260]:         </nova:port>
Nov 27 04:39:21 user nova-compute[75260]:       </nova:ports>
Nov 27 04:39:21 user nova-compute[75260]:     </nova:instance>
Nov 27 04:39:21 user nova-compute[75260]:   </metadata>
Nov 27 04:39:21 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:39:21 user nova-compute[75260]:     <system>
Nov 27 04:39:21 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:39:21 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:39:21 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:39:21 user nova-compute[75260]:       <entry name="serial">6d334344-945d-4718-9fa1-1464f6d0dad6</entry>
Nov 27 04:39:21 user nova-compute[75260]:       <entry name="uuid">6d334344-945d-4718-9fa1-1464f6d0dad6</entry>
Nov 27 04:39:21 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:39:21 user nova-compute[75260]:     </system>
Nov 27 04:39:21 user nova-compute[75260]:   </sysinfo>
Nov 27 04:39:21 user nova-compute[75260]:   <os>
Nov 27 04:39:21 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:39:21 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:39:21 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:39:21 user nova-compute[75260]:   </os>
Nov 27 04:39:21 user nova-compute[75260]:   <features>
Nov 27 04:39:21 user nova-compute[75260]:     <acpi/>
Nov 27 04:39:21 user nova-compute[75260]:     <apic/>
Nov 27 04:39:21 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:39:21 user nova-compute[75260]:   </features>
Nov 27 04:39:21 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:39:21 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:39:21 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:39:21 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:39:21 user nova-compute[75260]:   </clock>
Nov 27 04:39:21 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:39:21 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:39:21 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:39:21 user nova-compute[75260]:   </cpu>
Nov 27 04:39:21 user nova-compute[75260]:   <devices>
Nov 27 04:39:21 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:39:21 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:39:21 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk"/>
Nov 27 04:39:21 user nova-compute[75260]:       <target dev="sda" bus="scsi"/>
Nov 27 04:39:21 user nova-compute[75260]:       <address type="drive" controller="0" unit="0"/>
Nov 27 04:39:21 user nova-compute[75260]:     </disk>
Nov 27 04:39:21 user nova-compute[75260]:     <disk type="file" device="cdrom">
Nov 27 04:39:21 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 04:39:21 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk.config"/>
Nov 27 04:39:21 user nova-compute[75260]:       <target dev="sdb" bus="scsi"/>
Nov 27 04:39:21 user nova-compute[75260]:       <address type="drive" controller="0" unit="1"/>
Nov 27 04:39:21 user nova-compute[75260]:     </disk>
Nov 27 04:39:21 user nova-compute[75260]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 27 04:39:21 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:39:21 user nova-compute[75260]:       <mac address="fa:16:3e:73:18:61"/>
Nov 27 04:39:21 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:21 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:39:21 user nova-compute[75260]:       <target dev="tapd6f3da5b-76"/>
Nov 27 04:39:21 user nova-compute[75260]:     </interface>
Nov 27 04:39:21 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:39:21 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/console.log" append="off"/>
Nov 27 04:39:21 user nova-compute[75260]:     </serial>
Nov 27 04:39:21 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:39:21 user nova-compute[75260]:     <video>
Nov 27 04:39:21 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:21 user nova-compute[75260]:     </video>
Nov 27 04:39:21 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:39:21 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:39:21 user nova-compute[75260]:     </rng>
Nov 27 04:39:21 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:39:21 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:39:21 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:39:21 user nova-compute[75260]:     </memballoon>
Nov 27 04:39:21 user nova-compute[75260]:   </devices>
Nov 27 04:39:21 user nova-compute[75260]: </domain>
Nov 27 04:39:21 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1714191132',display_name='tempest-AttachSCSIVolumeTestJSON-server-1714191132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1714191132',id=8,image_ref='a69a1da0-dd6e-44ad-a31d-918637711477',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCtlEQRS9bwXkDK7hjRppMZyTnAanbiapdRI+0qmxtizYytIeK4Q7NcxhkaCd+uvqyy8cWDQzvntGvOghzARaRnqEF6pSzD59wDR0EMZ5O1uH6ria3eUJ5T2hv4RFd5VQ==',key_name='tempest-keypair-1613158922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6328ed7eccf41a4b5a3300302db99f5',ramdisk_id='',reservation_id='r-pkdf2dwl',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a69a1da0-dd6e-44ad-a31d-918637711477',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2046705655',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2046705655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='953e70264643472d8f691f3a171764c0',uuid=6d334344-945d-4718-9fa1-1464f6d0dad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Converting VIF {"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:18:61,bridge_name='br-int',has_traffic_filtering=True,id=d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6,network=Network(0f899e3b-4a56-43d6-8c2d-fe9b6b94be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f3da5b-76') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG os_vif [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:18:61,bridge_name='br-int',has_traffic_filtering=True,id=d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6,network=Network(0f899e3b-4a56-43d6-8c2d-fe9b6b94be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f3da5b-76') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2b59757-5876-5794-9a05-5d6c3b59d561', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6f3da5b-76, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6f3da5b-76, col_values=(('qos', UUID('a9566068-2685-4439-93e4-3ac9629f3009')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6f3da5b-76, col_values=(('external_ids', {'iface-id': 'd6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:18:61', 'vm-uuid': '6d334344-945d-4718-9fa1-1464f6d0dad6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:21 user nova-compute[75260]: INFO os_vif [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:18:61,bridge_name='br-int',has_traffic_filtering=True,id=d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6,network=Network(0f899e3b-4a56-43d6-8c2d-fe9b6b94be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f3da5b-76')
Nov 27 04:39:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] No BDM found with device name sda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] No VIF found with MAC fa:16:3e:73:18:61, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:39:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Using config drive
Nov 27 04:39:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Creating config drive at /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk.config
Nov 27 04:39:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgr8z_6jb {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgr8z_6jb" returned: 0 in 0.064s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.network.neutron [req-7c0ebfb1-1a3f-4409-b56d-68046df8d2ac req-2c2ecf5d-3ede-4028-9b64-ea25a62d5437 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Updated VIF entry in instance network info cache for port d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.network.neutron [req-7c0ebfb1-1a3f-4409-b56d-68046df8d2ac req-2c2ecf5d-3ede-4028-9b64-ea25a62d5437 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Updating instance_info_cache with network_info: [{"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7c0ebfb1-1a3f-4409-b56d-68046df8d2ac req-2c2ecf5d-3ede-4028-9b64-ea25a62d5437 service nova] Releasing lock "refresh_cache-6d334344-945d-4718-9fa1-1464f6d0dad6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.compute.manager [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:39:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Instance spawned successfully.
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:22 user nova-compute[75260]: INFO nova.compute.manager [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Took 8.68 seconds to spawn the instance on the hypervisor.
Nov 27 04:39:22 user nova-compute[75260]: DEBUG nova.compute.manager [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:39:22 user nova-compute[75260]: INFO nova.compute.manager [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Took 9.84 seconds to build instance.
Nov 27 04:39:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-83edd8de-c029-4366-aef2-2daf52b2f013 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.338s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:23 user nova-compute[75260]: DEBUG nova.compute.manager [req-8ef3ef10-9f70-453c-97a4-b08496b1a716 req-0ff47616-0f8f-40c2-9479-318eca69058d service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8ef3ef10-9f70-453c-97a4-b08496b1a716 req-0ff47616-0f8f-40c2-9479-318eca69058d service nova] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8ef3ef10-9f70-453c-97a4-b08496b1a716 req-0ff47616-0f8f-40c2-9479-318eca69058d service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8ef3ef10-9f70-453c-97a4-b08496b1a716 req-0ff47616-0f8f-40c2-9479-318eca69058d service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:23 user nova-compute[75260]: DEBUG nova.compute.manager [req-8ef3ef10-9f70-453c-97a4-b08496b1a716 req-0ff47616-0f8f-40c2-9479-318eca69058d service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] No waiting events found dispatching network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:23 user nova-compute[75260]: WARNING nova.compute.manager [req-8ef3ef10-9f70-453c-97a4-b08496b1a716 req-0ff47616-0f8f-40c2-9479-318eca69058d service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received unexpected event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 for instance with vm_state active and task_state None.
Nov 27 04:39:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] No waiting events found dispatching network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:25 user nova-compute[75260]: WARNING nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received unexpected event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 for instance with vm_state active and task_state None.
Nov 27 04:39:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:25 user nova-compute[75260]: WARNING nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state active and task_state None.
Nov 27 04:39:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:25 user nova-compute[75260]: WARNING nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state active and task_state None.
Nov 27 04:39:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received event network-vif-plugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Acquiring lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] No waiting events found dispatching network-vif-plugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:25 user nova-compute[75260]: WARNING nova.compute.manager [req-cdec1dbe-a953-4520-a09e-0ed89c2573c4 req-a7ec439e-fa57-4269-9b02-b6460149f6cf service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received unexpected event network-vif-plugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 for instance with vm_state active and task_state None.
Nov 27 04:39:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:39:27 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Instance spawned successfully.
Nov 27 04:39:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-43e778e7-6129-4a46-831b-f39e0325f2f3 req-ea4b85a9-c28f-4ac5-87f1-1fcc50ac6ee3 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received event network-vif-plugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-43e778e7-6129-4a46-831b-f39e0325f2f3 req-ea4b85a9-c28f-4ac5-87f1-1fcc50ac6ee3 service nova] Acquiring lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-43e778e7-6129-4a46-831b-f39e0325f2f3 req-ea4b85a9-c28f-4ac5-87f1-1fcc50ac6ee3 service nova] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-43e778e7-6129-4a46-831b-f39e0325f2f3 req-ea4b85a9-c28f-4ac5-87f1-1fcc50ac6ee3 service nova] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-43e778e7-6129-4a46-831b-f39e0325f2f3 req-ea4b85a9-c28f-4ac5-87f1-1fcc50ac6ee3 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] No waiting events found dispatching network-vif-plugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:27 user nova-compute[75260]: WARNING nova.compute.manager [req-43e778e7-6129-4a46-831b-f39e0325f2f3 req-ea4b85a9-c28f-4ac5-87f1-1fcc50ac6ee3 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received unexpected event network-vif-plugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 for instance with vm_state active and task_state None.
Nov 27 04:39:27 user nova-compute[75260]: INFO nova.compute.manager [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Took 10.40 seconds to spawn the instance on the hypervisor.
Nov 27 04:39:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:39:27 user nova-compute[75260]: INFO nova.compute.manager [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Took 12.23 seconds to build instance.
Nov 27 04:39:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b94ac2f5-4b7b-4079-8a18-4f019505a630 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.512s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "b6bca9d4-423b-406f-b016-037b8588be5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "b6bca9d4-423b-406f-b016-037b8588be5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:28 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:39:29 user nova-compute[75260]: INFO nova.compute.claims [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Claim successful on node user
Nov 27 04:39:29 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Acquiring lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:39:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:39:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG nova.policy [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0ebe750e82f4191a92790fef39693bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3faefb87e4411cbf63770a10d202bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:29 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:39:29 user nova-compute[75260]: INFO nova.compute.claims [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Claim successful on node user
Nov 27 04:39:29 user nova-compute[75260]: INFO nova.virt.block_device [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Booting with volume 4e37a540-ead2-434b-a6d3-d61c7190a1db at /dev/vda
Nov 27 04:39:30 user nova-compute[75260]: DEBUG os_brick.utils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:39:30 user nova-compute[75260]: INFO oslo.privsep.daemon [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpjonry5_8/privsep.sock']
Nov 27 04:39:30 user sudo[85812]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpjonry5_8/privsep.sock
Nov 27 04:39:30 user sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 27 04:39:30 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:39:30 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:39:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 04:39:30 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Successfully created port: 712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] There are 0 instances to clean {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 04:39:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.988s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:39:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75260) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 04:39:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.compute.manager [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:39:31 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.compute.manager [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.policy [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '999c2cafc10e4b6c88d711e46359f36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d663e698af432892b2131e20ad91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.compute.manager [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:39:31 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Creating image(s)
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Acquiring lock "/opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "/opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.016s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "/opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Successfully updated port: 712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "refresh_cache-b6bca9d4-423b-406f-b016-037b8588be5d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquired lock "refresh_cache-b6bca9d4-423b-406f-b016-037b8588be5d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.327s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-0d95585b-fe3e-4578-9e80-43b30a519d2e req-7df67f90-945d-4419-ab16-45301057ef12 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received event network-changed-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-0d95585b-fe3e-4578-9e80-43b30a519d2e req-7df67f90-945d-4419-ab16-45301057ef12 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Refreshing instance network info cache due to event network-changed-712b0a9c-0b19-4398-a084-c352567909a6. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0d95585b-fe3e-4578-9e80-43b30a519d2e req-7df67f90-945d-4419-ab16-45301057ef12 service nova] Acquiring lock "refresh_cache-b6bca9d4-423b-406f-b016-037b8588be5d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:31 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.352s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk 1073741824" returned: 0 in 0.092s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.451s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Updating instance_info_cache with network_info: [{"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Releasing lock "refresh_cache-b6bca9d4-423b-406f-b016-037b8588be5d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Instance network_info: |[{"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0d95585b-fe3e-4578-9e80-43b30a519d2e req-7df67f90-945d-4419-ab16-45301057ef12 service nova] Acquired lock "refresh_cache-b6bca9d4-423b-406f-b016-037b8588be5d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG nova.network.neutron [req-0d95585b-fe3e-4578-9e80-43b30a519d2e req-7df67f90-945d-4419-ab16-45301057ef12 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Refreshing network info cache for port 712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG nova.network.neutron [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Successfully created port: f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:32 user sudo[85812]: pam_unix(sudo:session): session closed for user root
Nov 27 04:39:32 user nova-compute[75260]: INFO oslo.privsep.daemon [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Spawned new privsep daemon via rootwrap
Nov 27 04:39:32 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 27 04:39:32 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 27 04:39:32 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 27 04:39:32 user nova-compute[75260]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85819
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.307s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f344ddc0-2e47-4063-8ad3-1f55712f2700]: (2,) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Cannot resize image /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Ensure instance console log exists: /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92ceb97-f569-432d-b453-1066c2de4517]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:32 user nova-compute[75260]: WARNING os_brick.initiator.connectors.nvmeof [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f22d11-3079-4715-a737-837352ea3897]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc0a69f-ebbe-4d37-b47a-507d67fff8f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2256f2-6438-4d29-b943-d47147d4ed7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG nova.network.neutron [req-0d95585b-fe3e-4578-9e80-43b30a519d2e req-7df67f90-945d-4419-ab16-45301057ef12 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Updated VIF entry in instance network info cache for port 712b0a9c-0b19-4398-a084-c352567909a6. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG nova.network.neutron [req-0d95585b-fe3e-4578-9e80-43b30a519d2e req-7df67f90-945d-4419-ab16-45301057ef12 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Updating instance_info_cache with network_info: [{"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:39:33 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:39:33 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c1d7c8-92f4-46d7-90a3-65fa312a027a]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0d95585b-fe3e-4578-9e80-43b30a519d2e req-7df67f90-945d-4419-ab16-45301057ef12 service nova] Releasing lock "refresh_cache-b6bca9d4-423b-406f-b016-037b8588be5d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG os_brick.utils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] <== get_connector_properties: return (2866ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Updating existing volume attachment record: fefb1b47-adeb-47cb-aac1-137167af29d3 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG nova.network.neutron [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Successfully updated port: f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Acquiring lock "refresh_cache-e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Acquired lock "refresh_cache-e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG nova.network.neutron [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG nova.compute.manager [req-5727a7a3-a136-4e8e-933b-47a7f92b1304 req-f4755bf9-99aa-4b35-832d-45b017efad96 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received event network-changed-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG nova.compute.manager [req-5727a7a3-a136-4e8e-933b-47a7f92b1304 req-f4755bf9-99aa-4b35-832d-45b017efad96 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Refreshing instance network info cache due to event network-changed-f89ade50-f29e-444e-a2fe-135804fe0477. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5727a7a3-a136-4e8e-933b-47a7f92b1304 req-f4755bf9-99aa-4b35-832d-45b017efad96 service nova] Acquiring lock "refresh_cache-e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG nova.network.neutron [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:33 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.network.neutron [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Updating instance_info_cache with network_info: [{"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Releasing lock "refresh_cache-e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Instance network_info: |[{"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5727a7a3-a136-4e8e-933b-47a7f92b1304 req-f4755bf9-99aa-4b35-832d-45b017efad96 service nova] Acquired lock "refresh_cache-e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.network.neutron [req-5727a7a3-a136-4e8e-933b-47a7f92b1304 req-f4755bf9-99aa-4b35-832d-45b017efad96 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Refreshing network info cache for port f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Start _get_guest_xml network_info=[{"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:39:34 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:34 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:39:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1347401076',display_name='tempest-VolumesAssistedSnapshotsTest-server-1347401076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1347401076',id=10,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcaoPsfC5YU5I4UbqhbwR80THAktxmtsDo38xNYkDV5J2KlU3kb944GgNFag/AsgycKeqYyUJo1LlQOJ6IghaD5/j9a5D9ENN2baD7+Q73nLZ7Yk6Yo4zOEfEyXFJDPCA==',key_name='tempest-keypair-928995188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d663e698af432892b2131e20ad91f7',ramdisk_id='',reservation_id='r-kfv5h403',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1845923318',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1845923318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999c2cafc10e4b6c88d711e46359f36c',uuid=e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Converting VIF {"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:72:fb,bridge_name='br-int',has_traffic_filtering=True,id=f89ade50-f29e-444e-a2fe-135804fe0477,network=Network(019d0aea-cd70-4421-b9c6-ba801817a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89ade50-f2') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.objects.instance [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lazy-loading 'pci_devices' on Instance uuid e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:39:34 user nova-compute[75260]:   <uuid>e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402</uuid>
Nov 27 04:39:34 user nova-compute[75260]:   <name>instance-0000000a</name>
Nov 27 04:39:34 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:39:34 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:39:34 user nova-compute[75260]:   <metadata>
Nov 27 04:39:34 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:39:34 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:39:34 user nova-compute[75260]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1347401076</nova:name>
Nov 27 04:39:34 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:39:34</nova:creationTime>
Nov 27 04:39:34 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:39:34 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:39:34 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:39:34 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:39:34 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:39:34 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:39:34 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:39:34 user nova-compute[75260]:       <nova:owner>
Nov 27 04:39:34 user nova-compute[75260]:         <nova:user uuid="999c2cafc10e4b6c88d711e46359f36c">tempest-VolumesAssistedSnapshotsTest-1845923318-project-member</nova:user>
Nov 27 04:39:34 user nova-compute[75260]:         <nova:project uuid="13d663e698af432892b2131e20ad91f7">tempest-VolumesAssistedSnapshotsTest-1845923318</nova:project>
Nov 27 04:39:34 user nova-compute[75260]:       </nova:owner>
Nov 27 04:39:34 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:39:34 user nova-compute[75260]:       <nova:ports>
Nov 27 04:39:34 user nova-compute[75260]:         <nova:port uuid="f89ade50-f29e-444e-a2fe-135804fe0477">
Nov 27 04:39:34 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 04:39:34 user nova-compute[75260]:         </nova:port>
Nov 27 04:39:34 user nova-compute[75260]:       </nova:ports>
Nov 27 04:39:34 user nova-compute[75260]:     </nova:instance>
Nov 27 04:39:34 user nova-compute[75260]:   </metadata>
Nov 27 04:39:34 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:39:34 user nova-compute[75260]:     <system>
Nov 27 04:39:34 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:39:34 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:39:34 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:39:34 user nova-compute[75260]:       <entry name="serial">e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402</entry>
Nov 27 04:39:34 user nova-compute[75260]:       <entry name="uuid">e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402</entry>
Nov 27 04:39:34 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:39:34 user nova-compute[75260]:     </system>
Nov 27 04:39:34 user nova-compute[75260]:   </sysinfo>
Nov 27 04:39:34 user nova-compute[75260]:   <os>
Nov 27 04:39:34 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:39:34 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:39:34 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:39:34 user nova-compute[75260]:   </os>
Nov 27 04:39:34 user nova-compute[75260]:   <features>
Nov 27 04:39:34 user nova-compute[75260]:     <acpi/>
Nov 27 04:39:34 user nova-compute[75260]:     <apic/>
Nov 27 04:39:34 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:39:34 user nova-compute[75260]:   </features>
Nov 27 04:39:34 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:39:34 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:39:34 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:39:34 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:39:34 user nova-compute[75260]:   </clock>
Nov 27 04:39:34 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:39:34 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:39:34 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:39:34 user nova-compute[75260]:   </cpu>
Nov 27 04:39:34 user nova-compute[75260]:   <devices>
Nov 27 04:39:34 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:39:34 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:39:34 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk"/>
Nov 27 04:39:34 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:39:34 user nova-compute[75260]:     </disk>
Nov 27 04:39:34 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:39:34 user nova-compute[75260]:       <mac address="fa:16:3e:62:72:fb"/>
Nov 27 04:39:34 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:34 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:39:34 user nova-compute[75260]:       <target dev="tapf89ade50-f2"/>
Nov 27 04:39:34 user nova-compute[75260]:     </interface>
Nov 27 04:39:34 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:39:34 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/console.log" append="off"/>
Nov 27 04:39:34 user nova-compute[75260]:     </serial>
Nov 27 04:39:34 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:39:34 user nova-compute[75260]:     <video>
Nov 27 04:39:34 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:34 user nova-compute[75260]:     </video>
Nov 27 04:39:34 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:39:34 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:39:34 user nova-compute[75260]:     </rng>
Nov 27 04:39:34 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:39:34 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:39:34 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:39:34 user nova-compute[75260]:     </memballoon>
Nov 27 04:39:34 user nova-compute[75260]:   </devices>
Nov 27 04:39:34 user nova-compute[75260]: </domain>
Nov 27 04:39:34 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:39:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1347401076',display_name='tempest-VolumesAssistedSnapshotsTest-server-1347401076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1347401076',id=10,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcaoPsfC5YU5I4UbqhbwR80THAktxmtsDo38xNYkDV5J2KlU3kb944GgNFag/AsgycKeqYyUJo1LlQOJ6IghaD5/j9a5D9ENN2baD7+Q73nLZ7Yk6Yo4zOEfEyXFJDPCA==',key_name='tempest-keypair-928995188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d663e698af432892b2131e20ad91f7',ramdisk_id='',reservation_id='r-kfv5h403',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1845923318',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1845923318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999c2cafc10e4b6c88d711e46359f36c',uuid=e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Converting VIF {"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:72:fb,bridge_name='br-int',has_traffic_filtering=True,id=f89ade50-f29e-444e-a2fe-135804fe0477,network=Network(019d0aea-cd70-4421-b9c6-ba801817a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89ade50-f2') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG os_vif [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:72:fb,bridge_name='br-int',has_traffic_filtering=True,id=f89ade50-f29e-444e-a2fe-135804fe0477,network=Network(019d0aea-cd70-4421-b9c6-ba801817a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89ade50-f2') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '248bbb43-2dc9-5468-912c-f25fcdbc76c5', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf89ade50-f2, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf89ade50-f2, col_values=(('qos', UUID('6e776cd8-1b0c-4664-afda-9baca3a2cbb3')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf89ade50-f2, col_values=(('external_ids', {'iface-id': 'f89ade50-f29e-444e-a2fe-135804fe0477', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:72:fb', 'vm-uuid': 'e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:34 user nova-compute[75260]: INFO os_vif [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:72:fb,bridge_name='br-int',has_traffic_filtering=True,id=f89ade50-f29e-444e-a2fe-135804fe0477,network=Network(019d0aea-cd70-4421-b9c6-ba801817a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89ade50-f2')
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] No VIF found with MAC fa:16:3e:62:72:fb, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.network.neutron [req-5727a7a3-a136-4e8e-933b-47a7f92b1304 req-f4755bf9-99aa-4b35-832d-45b017efad96 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Updated VIF entry in instance network info cache for port f89ade50-f29e-444e-a2fe-135804fe0477. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG nova.network.neutron [req-5727a7a3-a136-4e8e-933b-47a7f92b1304 req-f4755bf9-99aa-4b35-832d-45b017efad96 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Updating instance_info_cache with network_info: [{"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5727a7a3-a136-4e8e-933b-47a7f92b1304 req-f4755bf9-99aa-4b35-832d-45b017efad96 service nova] Releasing lock "refresh_cache-e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:35 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:39:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-b58e7370-87fc-4678-8ebb-306118081426 req-26846c37-a15b-4fa3-9909-e1490bf54965 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received event network-vif-plugged-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b58e7370-87fc-4678-8ebb-306118081426 req-26846c37-a15b-4fa3-9909-e1490bf54965 service nova] Acquiring lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b58e7370-87fc-4678-8ebb-306118081426 req-26846c37-a15b-4fa3-9909-e1490bf54965 service nova] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b58e7370-87fc-4678-8ebb-306118081426 req-26846c37-a15b-4fa3-9909-e1490bf54965 service nova] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-b58e7370-87fc-4678-8ebb-306118081426 req-26846c37-a15b-4fa3-9909-e1490bf54965 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] No waiting events found dispatching network-vif-plugged-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:37 user nova-compute[75260]: WARNING nova.compute.manager [req-b58e7370-87fc-4678-8ebb-306118081426 req-26846c37-a15b-4fa3-9909-e1490bf54965 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received unexpected event network-vif-plugged-f89ade50-f29e-444e-a2fe-135804fe0477 for instance with vm_state building and task_state spawning.
Nov 27 04:39:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:38 user nova-compute[75260]: DEBUG nova.compute.manager [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:39:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:39:38 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Instance spawned successfully.
Nov 27 04:39:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:39:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:38 user nova-compute[75260]: INFO nova.compute.manager [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Took 7.29 seconds to spawn the instance on the hypervisor.
Nov 27 04:39:38 user nova-compute[75260]: DEBUG nova.compute.manager [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:39:38 user nova-compute[75260]: INFO nova.compute.manager [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Took 8.97 seconds to build instance.
Nov 27 04:39:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71b4dea8-4954-46ee-a79b-2005f7413b7e tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.205s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-21036215-12a6-44de-b334-065d9672cc73 req-54928f53-3530-4101-b9ca-ea68f1587a42 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received event network-vif-plugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-21036215-12a6-44de-b334-065d9672cc73 req-54928f53-3530-4101-b9ca-ea68f1587a42 service nova] Acquiring lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-21036215-12a6-44de-b334-065d9672cc73 req-54928f53-3530-4101-b9ca-ea68f1587a42 service nova] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-21036215-12a6-44de-b334-065d9672cc73 req-54928f53-3530-4101-b9ca-ea68f1587a42 service nova] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-21036215-12a6-44de-b334-065d9672cc73 req-54928f53-3530-4101-b9ca-ea68f1587a42 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] No waiting events found dispatching network-vif-plugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:39 user nova-compute[75260]: WARNING nova.compute.manager [req-21036215-12a6-44de-b334-065d9672cc73 req-54928f53-3530-4101-b9ca-ea68f1587a42 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received unexpected event network-vif-plugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 for instance with vm_state active and task_state None.
Nov 27 04:39:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-9f5a2689-5e88-497b-96b5-5083bec35b29 req-2cad030c-7325-41c7-b5f7-373c31e6797e service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received event network-vif-plugged-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9f5a2689-5e88-497b-96b5-5083bec35b29 req-2cad030c-7325-41c7-b5f7-373c31e6797e service nova] Acquiring lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9f5a2689-5e88-497b-96b5-5083bec35b29 req-2cad030c-7325-41c7-b5f7-373c31e6797e service nova] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9f5a2689-5e88-497b-96b5-5083bec35b29 req-2cad030c-7325-41c7-b5f7-373c31e6797e service nova] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-9f5a2689-5e88-497b-96b5-5083bec35b29 req-2cad030c-7325-41c7-b5f7-373c31e6797e service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] No waiting events found dispatching network-vif-plugged-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:39 user nova-compute[75260]: WARNING nova.compute.manager [req-9f5a2689-5e88-497b-96b5-5083bec35b29 req-2cad030c-7325-41c7-b5f7-373c31e6797e service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received unexpected event network-vif-plugged-f89ade50-f29e-444e-a2fe-135804fe0477 for instance with vm_state active and task_state None.
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-2d51db2b-42f0-4688-9512-757550afbc55 req-d469ea82-688c-4e7c-b393-0e1a01a805aa service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received event network-vif-plugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2d51db2b-42f0-4688-9512-757550afbc55 req-d469ea82-688c-4e7c-b393-0e1a01a805aa service nova] Acquiring lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2d51db2b-42f0-4688-9512-757550afbc55 req-d469ea82-688c-4e7c-b393-0e1a01a805aa service nova] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2d51db2b-42f0-4688-9512-757550afbc55 req-d469ea82-688c-4e7c-b393-0e1a01a805aa service nova] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-2d51db2b-42f0-4688-9512-757550afbc55 req-d469ea82-688c-4e7c-b393-0e1a01a805aa service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] No waiting events found dispatching network-vif-plugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:41 user nova-compute[75260]: WARNING nova.compute.manager [req-2d51db2b-42f0-4688-9512-757550afbc55 req-d469ea82-688c-4e7c-b393-0e1a01a805aa service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received unexpected event network-vif-plugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 for instance with vm_state active and task_state None.
Nov 27 04:39:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:39:42 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Creating image(s)
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Ensure instance console log exists: /opt/stack/data/nova/instances/b6bca9d4-423b-406f-b016-037b8588be5d/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Start _get_guest_xml network_info=[{"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'fefb1b47-adeb-47cb-aac1-137167af29d3', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNqEAVyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b6bca9d4-423b-406f-b016-037b8588be5d', 'attached_at': '', 'detached_at': '', 'volume_id': '4e37a540-ead2-434b-a6d3-d61c7190a1db', 'serial': '4e37a540-ead2-434b-a6d3-d61c7190a1db'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:39:42 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:42 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:39:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connector [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Factory for ISCSI on None {{(pid=75260) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNqEAVyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:39:43 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:39:43 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:39:43 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d03493-84f1-467a-8404-b3c2d9d76641]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:39:43 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ba565a-b674-4ded-bdd8-322e565ec0b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db] added
Nov 27 04:39:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[904dae87-a4bd-475c-82f3-b05bf179a6a9]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[421cfea0-1913-46f4-a745-db1e435ed880]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNqEAVyv {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNqEAVyv" returned: 0 in 0.058s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[009da5f6-936f-42d4-8b56-2e1521e08cec]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mNqEAVyv'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.135s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d77ebb7-3581-4c4f-a3e2-a69ccfc42ece]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f2a174-550b-4584-be84-6cd13fe87747]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 04:39:43 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 04:39:43 user nova-compute[75260]:  {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:39:43 user nova-compute[75260]: WARNING os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 04:39:43 user nova-compute[75260]: 
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:44 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:44 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7410MB free_disk=25.705001831054688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --login" returned: 0 in 1.060s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d63ded-c4f8-4e9a-8c6b-3a8bc8884be2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db, portal: 172.16.0.220,3260]
Nov 27 04:39:44 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db, portal: 172.16.0.220,3260] successful.
Nov 27 04:39:44 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e283db59-758c-4891-a119-35f446d12945]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e691045d-fd65-47a1-9f8c-381ec19c467a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:39:44 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:39:44 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.574s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[83354cac-ae0b-49e6-b0f6-bb73dcd1e6e8]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNqEAVyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 12efb820-12ab-442d-a5fe-80b08f12a729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d47665e4-157a-46e2-85a3-1c5cde99db1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance cd971ad8-53b2-4088-9133-862ab89dc27e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance a5543a82-a320-4119-8d6e-0476226d619b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 6d334344-945d-4718-9fa1-1464f6d0dad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance b6bca9d4-423b-406f-b016-037b8588be5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing inventories for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating ProviderTree inventory for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing aggregate associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, aggregates: None {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 04:39:44 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing trait associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.083s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.619s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] <== connect_volume: return (2621ms) {'type': 'block', 'scsi_wwn': '26539613264626637', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539613264626637', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1665343800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1665343800',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALMxnrZzjW0NjXi7/0EuPIGfVftjzNb3zI9XvI/SPptD+18gVLb+KUb1OxRxRdLAsWLS+Gvv1ygIykhXU55vQi/O/jDUVMbsSLlF/YLQvWdSoHo8MWHv8KbCjNZZSENog==',key_name='tempest-keypair-1238704364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad3faefb87e4411cbf63770a10d202bd',ramdisk_id='',reservation_id='r-tdycmbuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1233607664',owner_user_name='tempest-ServerActionsV293TestJSON-1233607664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0ebe750e82f4191a92790fef39693bd',uuid=b6bca9d4-423b-406f-b016-037b8588be5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Converting VIF {"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=712b0a9c-0b19-4398-a084-c352567909a6,network=Network(9ed5e856-a6ab-4ec6-a7a0-162719214b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712b0a9c-0b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.objects.instance [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lazy-loading 'pci_devices' on Instance uuid b6bca9d4-423b-406f-b016-037b8588be5d {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:39:45 user nova-compute[75260]:   <uuid>b6bca9d4-423b-406f-b016-037b8588be5d</uuid>
Nov 27 04:39:45 user nova-compute[75260]:   <name>instance-00000009</name>
Nov 27 04:39:45 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:39:45 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:39:45 user nova-compute[75260]:   <metadata>
Nov 27 04:39:45 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:39:45 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:39:45 user nova-compute[75260]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1665343800</nova:name>
Nov 27 04:39:45 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:39:42</nova:creationTime>
Nov 27 04:39:45 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:39:45 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:39:45 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:39:45 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:39:45 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:39:45 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:39:45 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:39:45 user nova-compute[75260]:       <nova:owner>
Nov 27 04:39:45 user nova-compute[75260]:         <nova:user uuid="d0ebe750e82f4191a92790fef39693bd">tempest-ServerActionsV293TestJSON-1233607664-project-member</nova:user>
Nov 27 04:39:45 user nova-compute[75260]:         <nova:project uuid="ad3faefb87e4411cbf63770a10d202bd">tempest-ServerActionsV293TestJSON-1233607664</nova:project>
Nov 27 04:39:45 user nova-compute[75260]:       </nova:owner>
Nov 27 04:39:45 user nova-compute[75260]:       <nova:ports>
Nov 27 04:39:45 user nova-compute[75260]:         <nova:port uuid="712b0a9c-0b19-4398-a084-c352567909a6">
Nov 27 04:39:45 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 04:39:45 user nova-compute[75260]:         </nova:port>
Nov 27 04:39:45 user nova-compute[75260]:       </nova:ports>
Nov 27 04:39:45 user nova-compute[75260]:     </nova:instance>
Nov 27 04:39:45 user nova-compute[75260]:   </metadata>
Nov 27 04:39:45 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:39:45 user nova-compute[75260]:     <system>
Nov 27 04:39:45 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:39:45 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:39:45 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:39:45 user nova-compute[75260]:       <entry name="serial">b6bca9d4-423b-406f-b016-037b8588be5d</entry>
Nov 27 04:39:45 user nova-compute[75260]:       <entry name="uuid">b6bca9d4-423b-406f-b016-037b8588be5d</entry>
Nov 27 04:39:45 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:39:45 user nova-compute[75260]:     </system>
Nov 27 04:39:45 user nova-compute[75260]:   </sysinfo>
Nov 27 04:39:45 user nova-compute[75260]:   <os>
Nov 27 04:39:45 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:39:45 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:39:45 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:39:45 user nova-compute[75260]:   </os>
Nov 27 04:39:45 user nova-compute[75260]:   <features>
Nov 27 04:39:45 user nova-compute[75260]:     <acpi/>
Nov 27 04:39:45 user nova-compute[75260]:     <apic/>
Nov 27 04:39:45 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:39:45 user nova-compute[75260]:   </features>
Nov 27 04:39:45 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:39:45 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:39:45 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:39:45 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:39:45 user nova-compute[75260]:   </clock>
Nov 27 04:39:45 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:39:45 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:39:45 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:39:45 user nova-compute[75260]:   </cpu>
Nov 27 04:39:45 user nova-compute[75260]:   <devices>
Nov 27 04:39:45 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:39:45 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:39:45 user nova-compute[75260]:       <source dev="/dev/sdb"/>
Nov 27 04:39:45 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:39:45 user nova-compute[75260]:       <serial>4e37a540-ead2-434b-a6d3-d61c7190a1db</serial>
Nov 27 04:39:45 user nova-compute[75260]:     </disk>
Nov 27 04:39:45 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:39:45 user nova-compute[75260]:       <mac address="fa:16:3e:1d:4c:ef"/>
Nov 27 04:39:45 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:45 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:39:45 user nova-compute[75260]:       <target dev="tap712b0a9c-0b"/>
Nov 27 04:39:45 user nova-compute[75260]:     </interface>
Nov 27 04:39:45 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:39:45 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/b6bca9d4-423b-406f-b016-037b8588be5d/console.log" append="off"/>
Nov 27 04:39:45 user nova-compute[75260]:     </serial>
Nov 27 04:39:45 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:39:45 user nova-compute[75260]:     <video>
Nov 27 04:39:45 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:39:45 user nova-compute[75260]:     </video>
Nov 27 04:39:45 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:39:45 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:39:45 user nova-compute[75260]:     </rng>
Nov 27 04:39:45 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:39:45 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:39:45 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:39:45 user nova-compute[75260]:     </memballoon>
Nov 27 04:39:45 user nova-compute[75260]:   </devices>
Nov 27 04:39:45 user nova-compute[75260]: </domain>
Nov 27 04:39:45 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1665343800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1665343800',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALMxnrZzjW0NjXi7/0EuPIGfVftjzNb3zI9XvI/SPptD+18gVLb+KUb1OxRxRdLAsWLS+Gvv1ygIykhXU55vQi/O/jDUVMbsSLlF/YLQvWdSoHo8MWHv8KbCjNZZSENog==',key_name='tempest-keypair-1238704364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad3faefb87e4411cbf63770a10d202bd',ramdisk_id='',reservation_id='r-tdycmbuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1233607664',owner_user_name='tempest-ServerActionsV293TestJSON-1233607664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0ebe750e82f4191a92790fef39693bd',uuid=b6bca9d4-423b-406f-b016-037b8588be5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Converting VIF {"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=712b0a9c-0b19-4398-a084-c352567909a6,network=Network(9ed5e856-a6ab-4ec6-a7a0-162719214b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712b0a9c-0b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG os_vif [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=712b0a9c-0b19-4398-a084-c352567909a6,network=Network(9ed5e856-a6ab-4ec6-a7a0-162719214b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712b0a9c-0b') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35fea822-e749-5b5e-aaf6-0899d6516962', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap712b0a9c-0b, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap712b0a9c-0b, col_values=(('qos', UUID('ca81d7e4-b7a3-4b05-a95e-3d6812d44df7')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap712b0a9c-0b, col_values=(('external_ids', {'iface-id': '712b0a9c-0b19-4398-a084-c352567909a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:4c:ef', 'vm-uuid': 'b6bca9d4-423b-406f-b016-037b8588be5d'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:45 user nova-compute[75260]: INFO os_vif [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=712b0a9c-0b19-4398-a084-c352567909a6,network=Network(9ed5e856-a6ab-4ec6-a7a0-162719214b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712b0a9c-0b')
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:39:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] No VIF found with MAC fa:16:3e:1d:4c:ef, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:39:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:39:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:39:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Skipping network cache update for instance because it is Building. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 27 04:39:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:39:46 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updating instance_info_cache with network_info: [{"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-0cc83ec0-210c-4cf5-85ac-6e9fd89b152b req-d9878c6d-c576-4d8c-bff9-59aa65c891cd service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received event network-vif-plugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0cc83ec0-210c-4cf5-85ac-6e9fd89b152b req-d9878c6d-c576-4d8c-bff9-59aa65c891cd service nova] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0cc83ec0-210c-4cf5-85ac-6e9fd89b152b req-d9878c6d-c576-4d8c-bff9-59aa65c891cd service nova] Lock "a5543a82-a320-4119-8d6e-0476226d619b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0cc83ec0-210c-4cf5-85ac-6e9fd89b152b req-d9878c6d-c576-4d8c-bff9-59aa65c891cd service nova] Lock "a5543a82-a320-4119-8d6e-0476226d619b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-0cc83ec0-210c-4cf5-85ac-6e9fd89b152b req-d9878c6d-c576-4d8c-bff9-59aa65c891cd service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] No waiting events found dispatching network-vif-plugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:47 user nova-compute[75260]: WARNING nova.compute.manager [req-0cc83ec0-210c-4cf5-85ac-6e9fd89b152b req-d9878c6d-c576-4d8c-bff9-59aa65c891cd service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received unexpected event network-vif-plugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 for instance with vm_state active and task_state None.
Nov 27 04:39:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received event network-vif-plugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Lock "a5543a82-a320-4119-8d6e-0476226d619b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Lock "a5543a82-a320-4119-8d6e-0476226d619b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] No waiting events found dispatching network-vif-plugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:49 user nova-compute[75260]: WARNING nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received unexpected event network-vif-plugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 for instance with vm_state active and task_state None.
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received event network-vif-plugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Acquiring lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] No waiting events found dispatching network-vif-plugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:49 user nova-compute[75260]: WARNING nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received unexpected event network-vif-plugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 for instance with vm_state active and task_state None.
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received event network-vif-plugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Acquiring lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] No waiting events found dispatching network-vif-plugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:49 user nova-compute[75260]: WARNING nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received unexpected event network-vif-plugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 for instance with vm_state active and task_state None.
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received event network-vif-plugged-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Acquiring lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] No waiting events found dispatching network-vif-plugged-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:49 user nova-compute[75260]: WARNING nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received unexpected event network-vif-plugged-712b0a9c-0b19-4398-a084-c352567909a6 for instance with vm_state building and task_state spawning.
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received event network-vif-plugged-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Acquiring lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] No waiting events found dispatching network-vif-plugged-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:39:49 user nova-compute[75260]: WARNING nova.compute.manager [req-a6dfec03-9b28-46b5-88f1-ac5aaa5f20e5 req-b33074a0-8af7-4ec3-b3eb-dee6a88fe1b7 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received unexpected event network-vif-plugged-712b0a9c-0b19-4398-a084-c352567909a6 for instance with vm_state building and task_state spawning.
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:39:49 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Instance spawned successfully.
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:39:49 user nova-compute[75260]: INFO nova.compute.manager [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 27 04:39:49 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:39:49 user nova-compute[75260]: INFO nova.compute.manager [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Took 20.72 seconds to build instance.
Nov 27 04:39:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4cfc6da9-3f29-4b79-af1f-a70e8db31b1b tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "b6bca9d4-423b-406f-b016-037b8588be5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.852s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:39:50 user nova-compute[75260]: INFO nova.compute.claims [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Claim successful on node user
Nov 27 04:39:50 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:39:50 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:39:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:39:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:39:51 user nova-compute[75260]: INFO nova.virt.block_device [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Booting with volume 441b8be9-0fbd-4c6e-90ca-a5717762e4ad at /dev/vda
Nov 27 04:39:51 user nova-compute[75260]: DEBUG os_brick.utils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG nova.policy [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f159a82e22314218b9800585ddf19a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3d80de26114ff5964f85313abd9bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2546e63-6e5d-4d5e-b82f-d026cb5dcf34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea23c49-3f08-4e6e-8a87-cbe5d27bee37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59c5cef-0c47-4042-802c-5665931356a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4439de1-bddc-40f7-b980-be55055ccc2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:39:51 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:39:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd6640-b393-4580-919b-f69faa415c44]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG os_brick.utils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating existing volume attachment record: 1d93a372-a4dd-4e57-9998-260cee361bdf {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:39:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully created port: 084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:39:52 user nova-compute[75260]: INFO nova.compute.claims [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Claim successful on node user
Nov 27 04:39:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully created port: fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.756s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:39:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:39:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:39:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:39:53 user nova-compute[75260]: INFO nova.virt.block_device [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Booting with volume 40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 at /dev/vda
Nov 27 04:39:53 user nova-compute[75260]: DEBUG nova.policy [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43d426d6a5284e34a2cf5246ad52e210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc40027c0fdd4916b1a43367e9984462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG os_brick.utils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2af0cd-5fe6-4f10-a6ec-d13961bf0c88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9380192-f0b7-4b2e-a1fa-9c69918c8836]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully created port: ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d03684-62cd-4839-b0de-5ad92411bbe4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[093dbbd0-ba4b-4bf8-b339-867478cad483]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:39:53 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:39:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ed548b-d35d-4864-94ae-1dcd34bf62d5]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG os_brick.utils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:39:53 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating existing volume attachment record: 983182e3-724d-4e5e-8cc3-21e910f386e7 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:39:54 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully created port: 798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:54 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully created port: eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:54 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully created port: f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully created port: 0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully updated port: 084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6a78590-db26-4d37-853d-ceeaafd79367 req-26d7093a-6b57-4683-82c8-283cf9c5db2b service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-changed-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6a78590-db26-4d37-853d-ceeaafd79367 req-26d7093a-6b57-4683-82c8-283cf9c5db2b service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing instance network info cache due to event network-changed-084ca2c2-3de5-4914-8a78-c273fed9c7a5. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6a78590-db26-4d37-853d-ceeaafd79367 req-26d7093a-6b57-4683-82c8-283cf9c5db2b service nova] Acquiring lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6a78590-db26-4d37-853d-ceeaafd79367 req-26d7093a-6b57-4683-82c8-283cf9c5db2b service nova] Acquired lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:55 user nova-compute[75260]: DEBUG nova.network.neutron [req-a6a78590-db26-4d37-853d-ceeaafd79367 req-26d7093a-6b57-4683-82c8-283cf9c5db2b service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing network info cache for port 084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully created port: 06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:55 user nova-compute[75260]: DEBUG nova.network.neutron [req-a6a78590-db26-4d37-853d-ceeaafd79367 req-26d7093a-6b57-4683-82c8-283cf9c5db2b service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:39:56 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully created port: 6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-a6a78590-db26-4d37-853d-ceeaafd79367 req-26d7093a-6b57-4683-82c8-283cf9c5db2b service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6a78590-db26-4d37-853d-ceeaafd79367 req-26d7093a-6b57-4683-82c8-283cf9c5db2b service nova] Releasing lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:56 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully updated port: be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:56 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully created port: e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully updated port: 7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully updated port: eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-a582eb30-3279-40b2-a184-5bbbe7f085d6 req-23116510-2584-4c65-ad00-f8d945ce0aa9 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-changed-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-a582eb30-3279-40b2-a184-5bbbe7f085d6 req-23116510-2584-4c65-ad00-f8d945ce0aa9 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing instance network info cache due to event network-changed-eeb0783a-b889-41cc-bf3d-7860e57b193d. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a582eb30-3279-40b2-a184-5bbbe7f085d6 req-23116510-2584-4c65-ad00-f8d945ce0aa9 service nova] Acquiring lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a582eb30-3279-40b2-a184-5bbbe7f085d6 req-23116510-2584-4c65-ad00-f8d945ce0aa9 service nova] Acquired lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-a582eb30-3279-40b2-a184-5bbbe7f085d6 req-23116510-2584-4c65-ad00-f8d945ce0aa9 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing network info cache for port eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully updated port: fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-a582eb30-3279-40b2-a184-5bbbe7f085d6 req-23116510-2584-4c65-ad00-f8d945ce0aa9 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-changed-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing instance network info cache due to event network-changed-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] Acquiring lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] Acquired lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing network info cache for port be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-a582eb30-3279-40b2-a184-5bbbe7f085d6 req-23116510-2584-4c65-ad00-f8d945ce0aa9 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a582eb30-3279-40b2-a184-5bbbe7f085d6 req-23116510-2584-4c65-ad00-f8d945ce0aa9 service nova] Releasing lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] Releasing lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-changed-7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing instance network info cache due to event network-changed-7b99af86-ba33-40ca-9a5a-04b97613e9e7. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] Acquiring lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] Acquired lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing network info cache for port 7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully updated port: 2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:58 user nova-compute[75260]: INFO nova.virt.block_device [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Booting with volume fc65e917-0768-4abf-a881-66d6e93f2afc at /dev/vdb
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG os_brick.utils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b906c0ac-832b-40b9-91e6-99fefae824db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5503335-e5dd-4b42-999a-122942975c59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89858e7-a5ed-47ad-a80d-9bcc0d94ed15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f66ce1-8117-445d-be89-b347c221345d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully updated port: ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:39:58 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e2b0c1-9068-4647-85bf-3de0361be51f]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG os_brick.utils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating existing volume attachment record: c0b34862-a438-4361-99ad-0689c67dec9f {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] Releasing lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-changed-fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing instance network info cache due to event network-changed-fc89f3be-50cd-435f-a9df-3987fb4404f8. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] Acquiring lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] Acquired lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing network info cache for port fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully updated port: a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:58 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully updated port: 798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ad5729-107e-4626-85c0-d837ac43ab0c req-91c41e82-5e93-434f-8c03-66969c63c114 service nova] Releasing lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-f57c29b0-c53e-49e2-bb2f-64cb45dbb693 req-d3028b84-d26d-4d47-b3a4-3a6675af35c2 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-changed-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-f57c29b0-c53e-49e2-bb2f-64cb45dbb693 req-d3028b84-d26d-4d47-b3a4-3a6675af35c2 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing instance network info cache due to event network-changed-798cf9c6-2c78-4f74-8a69-2ea7d378fc43. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f57c29b0-c53e-49e2-bb2f-64cb45dbb693 req-d3028b84-d26d-4d47-b3a4-3a6675af35c2 service nova] Acquiring lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f57c29b0-c53e-49e2-bb2f-64cb45dbb693 req-d3028b84-d26d-4d47-b3a4-3a6675af35c2 service nova] Acquired lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-f57c29b0-c53e-49e2-bb2f-64cb45dbb693 req-d3028b84-d26d-4d47-b3a4-3a6675af35c2 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing network info cache for port 798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-f57c29b0-c53e-49e2-bb2f-64cb45dbb693 req-d3028b84-d26d-4d47-b3a4-3a6675af35c2 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-f57c29b0-c53e-49e2-bb2f-64cb45dbb693 req-d3028b84-d26d-4d47-b3a4-3a6675af35c2 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f57c29b0-c53e-49e2-bb2f-64cb45dbb693 req-d3028b84-d26d-4d47-b3a4-3a6675af35c2 service nova] Releasing lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully updated port: 0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Successfully updated port: f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-changed-2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing instance network info cache due to event network-changed-2de06c44-2283-4cdb-bf1f-962fdd3053a1. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] Acquiring lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] Acquired lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing network info cache for port 2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquired lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-changed-ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing instance network info cache due to event network-changed-ee28ffb6-999b-4675-85c6-2226b726bba7. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] Acquiring lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] Releasing lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-changed-a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing instance network info cache due to event network-changed-a62d1e1d-4a02-44b5-802f-114dc6320858. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] Acquiring lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] Acquired lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:39:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing network info cache for port a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully updated port: 06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] Releasing lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-changed-0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing instance network info cache due to event network-changed-0ad3d43a-6008-4f21-a1a2-6aec72523960. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] Acquiring lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] Acquired lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing network info cache for port 0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10f0fe36-8629-4404-95d8-85374172dbf5 req-b51f43f9-be81-4b28-b9b5-2f16b76f61c6 service nova] Releasing lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully updated port: 6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:40:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Successfully updated port: e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquired lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG nova.network.neutron [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [{"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Releasing lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Instance network_info: |[{"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] Acquired lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG nova.network.neutron [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing network info cache for port ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG nova.compute.manager [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-changed-06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG nova.compute.manager [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing instance network info cache due to event network-changed-06fc3d26-c623-4672-8580-0403fad18d83. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] Acquiring lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:01 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG nova.network.neutron [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updated VIF entry in instance network info cache for port ee28ffb6-999b-4675-85c6-2226b726bba7. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG nova.network.neutron [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [{"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] Releasing lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-changed-f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing instance network info cache due to event network-changed-f2b47078-4add-42be-9d9b-b67f20f530d8. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] Acquiring lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] Acquired lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG nova.network.neutron [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing network info cache for port f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG nova.network.neutron [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updated VIF entry in instance network info cache for port f2b47078-4add-42be-9d9b-b67f20f530d8. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG nova.network.neutron [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [{"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1d8a1a63-fa14-44cc-b5a7-04acfb7f7117 req-e851bdc2-22a7-4d74-841c-22f7af1781d8 service nova] Releasing lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:03 user nova-compute[75260]: INFO nova.virt.block_device [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Booting with volume 409251ea-c7b3-458d-bd21-c589313b2ad9 at /dev/vdb
Nov 27 04:40:03 user nova-compute[75260]: DEBUG os_brick.utils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[47db3b66-471b-409f-961f-a549f46c95f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[059c81f8-54a5-4194-9804-fbabd4618533]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba79b4b4-a9db-4d1c-b6b8-5c232ea9adfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[480822a0-e626-4647-bffb-75d6d3befbcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:03 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e332ea78-24cf-4c6c-a724-1e1ac0037993]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG os_brick.utils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating existing volume attachment record: 6de0a91a-1304-4bc1-8818-11d3055b026c {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [{"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Releasing lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Instance network_info: |[{"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] Acquired lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:03 user nova-compute[75260]: DEBUG nova.network.neutron [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing network info cache for port 06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updated VIF entry in instance network info cache for port 06fc3d26-c623-4672-8580-0403fad18d83. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [{"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] Releasing lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-changed-6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing instance network info cache due to event network-changed-6bf9d769-b7d2-48dc-9254-f10f32c7f632. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] Acquiring lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] Acquired lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing network info cache for port 6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updated VIF entry in instance network info cache for port 6bf9d769-b7d2-48dc-9254-f10f32c7f632. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [{"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] Releasing lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-changed-e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing instance network info cache due to event network-changed-e3182588-d313-45c7-981c-25ff46efdae8. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] Acquiring lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] Acquired lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing network info cache for port e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG nova.network.neutron [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updated VIF entry in instance network info cache for port e3182588-d313-45c7-981c-25ff46efdae8. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG nova.network.neutron [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [{"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a8b4523c-6632-4e7b-9cc8-ac063f444fbe req-502b733c-794d-442f-baef-c134945dcb04 service nova] Releasing lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:05 user nova-compute[75260]: INFO nova.virt.block_device [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Booting with volume 1b7cc315-86b0-4b49-a74d-9ef83e65dd95 at /dev/vdc
Nov 27 04:40:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG os_brick.utils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a6b263-0ae5-43c0-a164-215e78897d30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[837ccb8b-a5f7-44fe-9ea3-f2289e072cf3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e919f0-7c47-4fc8-8671-268f5551979d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b9c1e1-c717-4635-829f-9e49c9a9d9fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:05 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:40:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b72ab1-0424-4727-b943-66f9121a8597]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG os_brick.utils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:05 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating existing volume attachment record: 2c6ba451-eec3-4ea1-b4ff-1ea63ca1869f {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:40:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:12 user nova-compute[75260]: INFO nova.virt.block_device [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Booting with volume ba5ddc4b-44d9-4674-b31d-b481e7609898 at /dev/vdc
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.utils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e880f6-56cb-433e-b2aa-18d66342cbf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa38a7ed-63de-4eca-b8c7-995829991e4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3d980f-1cf0-477b-99d4-4c4e993db161]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4bd81a-1d4a-427f-ac4d-ed5fab4a28e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:12 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b28017-b92c-4072-be6f-dd8c187e13d9]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.utils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating existing volume attachment record: c567ae1a-fa64-4ad7-ae7b-0a022a2d4210 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:40:12 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Creating image(s)
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Ensure instance console log exists: /opt/stack/data/nova/instances/b511b968-5c5b-4c17-9d14-cccc3bc7d7e6/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Start _get_guest_xml network_info=[{"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '1d93a372-a4dd-4e57-9998-260cee361bdf', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwabzDyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b511b968-5c5b-4c17-9d14-cccc3bc7d7e6', 'attached_at': '', 'detached_at': '', 'volume_id': '441b8be9-0fbd-4c6e-90ca-a5717762e4ad', 'serial': '441b8be9-0fbd-4c6e-90ca-a5717762e4ad'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}, {'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'c0b34862-a438-4361-99ad-0689c67dec9f', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQPcGbUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b511b968-5c5b-4c17-9d14-cccc3bc7d7e6', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc65e917-0768-4abf-a881-66d6e93f2afc', 'serial': 'fc65e917-0768-4abf-a881-66d6e93f2afc'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 1, 'volume_type': None}, {'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': '2c6ba451-eec3-4ea1-b4ff-1ea63ca1869f', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geDLyBdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b511b968-5c5b-4c17-9d14-cccc3bc7d7e6', 'attached_at': '', 'detached_at': '', 'volume_id': '1b7cc315-86b0-4b49-a74d-9ef83e65dd95', 'serial': '1b7cc315-86b0-4b49-a74d-9ef83e65dd95'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 2, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:40:12 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:40:12 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwabzDyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:12 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:12 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:12 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8eab5-b679-4acb-b7fa-779be58b863b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:40:12 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee58563-09f6-41c3-a07c-081b5f80fafa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad] added
Nov 27 04:40:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5d4e95-9706-4ef1-82b9-3d5688b9c15c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fccb0b-6058-4ae4-97ec-895522f75766]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwabzDyO {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwabzDyO" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da15709-aaaa-4fef-986a-5a22857fd356]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QwabzDyO'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d935a4-d1e9-4a8d-8364-9f2711c3743b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d57a19a-8f34-4c09-bbf6-bc759bb37f33]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[178150b6-b12f-437f-98ce-27d682373ecf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad, portal: 172.16.0.220,3260]
Nov 27 04:40:13 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad, portal: 172.16.0.220,3260] successful.
Nov 27 04:40:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9c69a4-2847-4eba-aa98-6e72c02a90fb]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4156c0b7-3ba7-461c-9ffc-8c1324965338]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:13 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:13 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed0b6c6-9a41-42a1-8357-85f36fc3d592]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:40:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwabzDyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26563636334633230', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563636334633230', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQPcGbUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:14 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:14 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:14 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b5a81e-1387-4d24-b259-e7b226208934]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:40:14 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[633cb5a3-012e-4382-9861-ffd74df049db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc] added
Nov 27 04:40:14 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[829859ff-6032-486d-b21f-a675c3d0efe0]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a93b48-437b-4543-8b85-046de5b2ea6e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQPcGbUa {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQPcGbUa" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5cb1b2-8eed-4007-ab3c-7d52512f64a8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qQPcGbUa'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[403cf7e9-9286-41a2-aec2-197bfaa9b0a1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4634526b-523f-413a-834d-1a56070cf581]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:14 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:14 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:14 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:14 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0f910c-d6c8-4bb6-805a-713809cab365]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc, portal: 172.16.0.220,3260]
Nov 27 04:40:14 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc, portal: 172.16.0.220,3260] successful.
Nov 27 04:40:14 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[45025c82-b9c4-4737-8492-5442e2674fb6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a1f5c1-014a-4045-ac36-70da09684dbc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:14 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:14 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:14 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:14 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:14 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:14 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[426274cd-b69e-4722-8278-d334e99aca40]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:40:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQPcGbUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23035623565643139', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035623565643139', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geDLyBdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:15 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:15 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:15 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebce7caa-f969-4b70-9031-576dc3a63f98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:40:15 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[724cd06e-0670-4178-8c6c-116e1046e00a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95] added
Nov 27 04:40:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f35391-d855-451d-8d0b-1500982146e4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d86fb7-de01-430c-8fac-95798895c317]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geDLyBdp {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geDLyBdp" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b925b40-2af3-4faf-bb29-1f45fc2ebe43]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'geDLyBdp'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[72043420-e66b-4fe2-8101-ce82362b6fb9]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b3f3b2-e854-478c-a324-6000e183763f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:15 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:15 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:15 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:15 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b91d36-0bba-467f-98ac-6b40b97a5942]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95, portal: 172.16.0.220,3260]
Nov 27 04:40:15 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95, portal: 172.16.0.220,3260] successful.
Nov 27 04:40:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c693c96c-8c61-4ea8-8098-f201e969fd50]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8421b9e-b7d6-45ca-939f-3890583bfd27]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:15 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:15 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:15 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:15 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:15 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:15 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[789dfba8-6757-4ea3-8bc1-817faceb9783]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:40:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geDLyBdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23861373837343337', 'path': '/dev/sde'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861373837343337', 'path': '/dev/sde'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:77:22,bridge_name='br-int',has_traffic_filtering=True,id=084ca2c2-3de5-4914-8a78-c273fed9c7a5,network=Network(ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084ca2c2-3d') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=be10c8c6-5acf-4d1c-96ea-33a907b1ef3c,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe10c8c6-5a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:16 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:ac,bridge_name='br-int',has_traffic_filtering=True,id=7b99af86-ba33-40ca-9a5a-04b97613e9e7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b99af86-ba') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d0:bc,bridge_name='br-int',has_traffic_filtering=True,id=fc89f3be-50cd-435f-a9df-3987fb4404f8,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc89f3be-50') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0d:74,bridge_name='br-int',has_traffic_filtering=True,id=ee28ffb6-999b-4675-85c6-2226b726bba7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee28ffb6-99') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:02:d1,bridge_name='br-int',has_traffic_filtering=True,id=798cf9c6-2c78-4f74-8a69-2ea7d378fc43,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf9c6-2c') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:57,bridge_name='br-int',has_traffic_filtering=True,id=f2b47078-4add-42be-9d9b-b67f20f530d8,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b47078-4a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.objects.instance [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lazy-loading 'pci_devices' on Instance uuid b511b968-5c5b-4c17-9d14-cccc3bc7d7e6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:40:17 user nova-compute[75260]:   <uuid>b511b968-5c5b-4c17-9d14-cccc3bc7d7e6</uuid>
Nov 27 04:40:17 user nova-compute[75260]:   <name>instance-0000000b</name>
Nov 27 04:40:17 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:40:17 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:40:17 user nova-compute[75260]:   <metadata>
Nov 27 04:40:17 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:40:17 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:40:17 user nova-compute[75260]:       <nova:name>tempest-device-tagging-server-2103664123</nova:name>
Nov 27 04:40:17 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:40:12</nova:creationTime>
Nov 27 04:40:17 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:40:17 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:40:17 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:40:17 user nova-compute[75260]:       <nova:owner>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:user uuid="f159a82e22314218b9800585ddf19a15">tempest-TaggedBootDevicesTest_v242-1968195477-project-member</nova:user>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:project uuid="0b3d80de26114ff5964f85313abd9bb9">tempest-TaggedBootDevicesTest_v242-1968195477</nova:project>
Nov 27 04:40:17 user nova-compute[75260]:       </nova:owner>
Nov 27 04:40:17 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:40:17 user nova-compute[75260]:       <nova:ports>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:port uuid="084ca2c2-3de5-4914-8a78-c273fed9c7a5">
Nov 27 04:40:17 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 04:40:17 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:port uuid="be10c8c6-5acf-4d1c-96ea-33a907b1ef3c">
Nov 27 04:40:17 user nova-compute[75260]:           <nova:ip type="fixed" address="10.1.1.138" ipVersion="4"/>
Nov 27 04:40:17 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:port uuid="7b99af86-ba33-40ca-9a5a-04b97613e9e7">
Nov 27 04:40:17 user nova-compute[75260]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Nov 27 04:40:17 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:port uuid="fc89f3be-50cd-435f-a9df-3987fb4404f8">
Nov 27 04:40:17 user nova-compute[75260]:           <nova:ip type="fixed" address="10.1.1.113" ipVersion="4"/>
Nov 27 04:40:17 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:port uuid="ee28ffb6-999b-4675-85c6-2226b726bba7">
Nov 27 04:40:17 user nova-compute[75260]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Nov 27 04:40:17 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:port uuid="798cf9c6-2c78-4f74-8a69-2ea7d378fc43">
Nov 27 04:40:17 user nova-compute[75260]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 27 04:40:17 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:17 user nova-compute[75260]:         <nova:port uuid="f2b47078-4add-42be-9d9b-b67f20f530d8">
Nov 27 04:40:17 user nova-compute[75260]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 27 04:40:17 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:17 user nova-compute[75260]:       </nova:ports>
Nov 27 04:40:17 user nova-compute[75260]:     </nova:instance>
Nov 27 04:40:17 user nova-compute[75260]:   </metadata>
Nov 27 04:40:17 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:40:17 user nova-compute[75260]:     <system>
Nov 27 04:40:17 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:40:17 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:40:17 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:40:17 user nova-compute[75260]:       <entry name="serial">b511b968-5c5b-4c17-9d14-cccc3bc7d7e6</entry>
Nov 27 04:40:17 user nova-compute[75260]:       <entry name="uuid">b511b968-5c5b-4c17-9d14-cccc3bc7d7e6</entry>
Nov 27 04:40:17 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:40:17 user nova-compute[75260]:     </system>
Nov 27 04:40:17 user nova-compute[75260]:   </sysinfo>
Nov 27 04:40:17 user nova-compute[75260]:   <os>
Nov 27 04:40:17 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:40:17 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:40:17 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:40:17 user nova-compute[75260]:   </os>
Nov 27 04:40:17 user nova-compute[75260]:   <features>
Nov 27 04:40:17 user nova-compute[75260]:     <acpi/>
Nov 27 04:40:17 user nova-compute[75260]:     <apic/>
Nov 27 04:40:17 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:40:17 user nova-compute[75260]:   </features>
Nov 27 04:40:17 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:40:17 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:40:17 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:40:17 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:40:17 user nova-compute[75260]:   </clock>
Nov 27 04:40:17 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:40:17 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:40:17 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:40:17 user nova-compute[75260]:   </cpu>
Nov 27 04:40:17 user nova-compute[75260]:   <devices>
Nov 27 04:40:17 user nova-compute[75260]:     <disk type="file" device="cdrom">
Nov 27 04:40:17 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 04:40:17 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/b511b968-5c5b-4c17-9d14-cccc3bc7d7e6/disk.config"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="hda" bus="ide"/>
Nov 27 04:40:17 user nova-compute[75260]:     </disk>
Nov 27 04:40:17 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:40:17 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:40:17 user nova-compute[75260]:       <source dev="/dev/sdc"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:       <serial>441b8be9-0fbd-4c6e-90ca-a5717762e4ad</serial>
Nov 27 04:40:17 user nova-compute[75260]:     </disk>
Nov 27 04:40:17 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:40:17 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:40:17 user nova-compute[75260]:       <source dev="/dev/sdd"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:       <serial>fc65e917-0768-4abf-a881-66d6e93f2afc</serial>
Nov 27 04:40:17 user nova-compute[75260]:     </disk>
Nov 27 04:40:17 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:40:17 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:40:17 user nova-compute[75260]:       <source dev="/dev/sde"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="vdc" bus="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:       <serial>1b7cc315-86b0-4b49-a74d-9ef83e65dd95</serial>
Nov 27 04:40:17 user nova-compute[75260]:     </disk>
Nov 27 04:40:17 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:17 user nova-compute[75260]:       <mac address="fa:16:3e:ae:77:22"/>
Nov 27 04:40:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="tap084ca2c2-3d"/>
Nov 27 04:40:17 user nova-compute[75260]:     </interface>
Nov 27 04:40:17 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:17 user nova-compute[75260]:       <mac address="fa:16:3e:5a:0c:cf"/>
Nov 27 04:40:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="tapbe10c8c6-5a"/>
Nov 27 04:40:17 user nova-compute[75260]:     </interface>
Nov 27 04:40:17 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:17 user nova-compute[75260]:       <mac address="fa:16:3e:2f:02:ac"/>
Nov 27 04:40:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="tap7b99af86-ba"/>
Nov 27 04:40:17 user nova-compute[75260]:     </interface>
Nov 27 04:40:17 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:17 user nova-compute[75260]:       <mac address="fa:16:3e:ec:d0:bc"/>
Nov 27 04:40:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="tapfc89f3be-50"/>
Nov 27 04:40:17 user nova-compute[75260]:     </interface>
Nov 27 04:40:17 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:17 user nova-compute[75260]:       <mac address="fa:16:3e:b5:0d:74"/>
Nov 27 04:40:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="tapee28ffb6-99"/>
Nov 27 04:40:17 user nova-compute[75260]:     </interface>
Nov 27 04:40:17 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:17 user nova-compute[75260]:       <mac address="fa:16:3e:f4:02:d1"/>
Nov 27 04:40:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="tap798cf9c6-2c"/>
Nov 27 04:40:17 user nova-compute[75260]:     </interface>
Nov 27 04:40:17 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:17 user nova-compute[75260]:       <mac address="fa:16:3e:30:62:57"/>
Nov 27 04:40:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:17 user nova-compute[75260]:       <target dev="tapf2b47078-4a"/>
Nov 27 04:40:17 user nova-compute[75260]:     </interface>
Nov 27 04:40:17 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:40:17 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/b511b968-5c5b-4c17-9d14-cccc3bc7d7e6/console.log" append="off"/>
Nov 27 04:40:17 user nova-compute[75260]:     </serial>
Nov 27 04:40:17 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:40:17 user nova-compute[75260]:     <video>
Nov 27 04:40:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:17 user nova-compute[75260]:     </video>
Nov 27 04:40:17 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:40:17 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:40:17 user nova-compute[75260]:     </rng>
Nov 27 04:40:17 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:40:17 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:40:17 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:40:17 user nova-compute[75260]:     </memballoon>
Nov 27 04:40:17 user nova-compute[75260]:   </devices>
Nov 27 04:40:17 user nova-compute[75260]: </domain>
Nov 27 04:40:17 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:77:22,bridge_name='br-int',has_traffic_filtering=True,id=084ca2c2-3de5-4914-8a78-c273fed9c7a5,network=Network(ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084ca2c2-3d') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:77:22,bridge_name='br-int',has_traffic_filtering=True,id=084ca2c2-3de5-4914-8a78-c273fed9c7a5,network=Network(ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084ca2c2-3d') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42bf0f60-faa1-5007-a4bb-4e81566782cb', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap084ca2c2-3d, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap084ca2c2-3d, col_values=(('qos', UUID('7c51d1dc-dc5e-4b40-8ff3-40e3bcbb0b50')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap084ca2c2-3d, col_values=(('external_ids', {'iface-id': '084ca2c2-3de5-4914-8a78-c273fed9c7a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:77:22', 'vm-uuid': 'b511b968-5c5b-4c17-9d14-cccc3bc7d7e6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: INFO os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:77:22,bridge_name='br-int',has_traffic_filtering=True,id=084ca2c2-3de5-4914-8a78-c273fed9c7a5,network=Network(ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084ca2c2-3d')
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=be10c8c6-5acf-4d1c-96ea-33a907b1ef3c,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe10c8c6-5a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=be10c8c6-5acf-4d1c-96ea-33a907b1ef3c,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe10c8c6-5a') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b22f510e-d5d3-5033-a047-da31b89b1a17', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe10c8c6-5a, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe10c8c6-5a, col_values=(('qos', UUID('5960bb2f-8ef0-4b3e-a236-efbb49febf99')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe10c8c6-5a, col_values=(('external_ids', {'iface-id': 'be10c8c6-5acf-4d1c-96ea-33a907b1ef3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:0c:cf', 'vm-uuid': 'b511b968-5c5b-4c17-9d14-cccc3bc7d7e6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: INFO os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=be10c8c6-5acf-4d1c-96ea-33a907b1ef3c,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe10c8c6-5a')
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:ac,bridge_name='br-int',has_traffic_filtering=True,id=7b99af86-ba33-40ca-9a5a-04b97613e9e7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b99af86-ba') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:ac,bridge_name='br-int',has_traffic_filtering=True,id=7b99af86-ba33-40ca-9a5a-04b97613e9e7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b99af86-ba') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '968fdce1-b385-5c16-9839-67d84b3103dd', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b99af86-ba, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b99af86-ba, col_values=(('qos', UUID('20448ba3-0e8b-4a40-936a-a15fdb836d53')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b99af86-ba, col_values=(('external_ids', {'iface-id': '7b99af86-ba33-40ca-9a5a-04b97613e9e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:02:ac', 'vm-uuid': 'b511b968-5c5b-4c17-9d14-cccc3bc7d7e6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: INFO os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:ac,bridge_name='br-int',has_traffic_filtering=True,id=7b99af86-ba33-40ca-9a5a-04b97613e9e7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b99af86-ba')
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d0:bc,bridge_name='br-int',has_traffic_filtering=True,id=fc89f3be-50cd-435f-a9df-3987fb4404f8,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc89f3be-50') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d0:bc,bridge_name='br-int',has_traffic_filtering=True,id=fc89f3be-50cd-435f-a9df-3987fb4404f8,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc89f3be-50') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cc8d62a-e521-5a98-a6bd-c3bce0189e5e', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc89f3be-50, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc89f3be-50, col_values=(('qos', UUID('d3e16103-848d-4eb7-ad0d-fd05d779a7fa')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc89f3be-50, col_values=(('external_ids', {'iface-id': 'fc89f3be-50cd-435f-a9df-3987fb4404f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:d0:bc', 'vm-uuid': 'b511b968-5c5b-4c17-9d14-cccc3bc7d7e6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: INFO os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d0:bc,bridge_name='br-int',has_traffic_filtering=True,id=fc89f3be-50cd-435f-a9df-3987fb4404f8,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc89f3be-50')
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0d:74,bridge_name='br-int',has_traffic_filtering=True,id=ee28ffb6-999b-4675-85c6-2226b726bba7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee28ffb6-99') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0d:74,bridge_name='br-int',has_traffic_filtering=True,id=ee28ffb6-999b-4675-85c6-2226b726bba7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee28ffb6-99') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37601832-86eb-5a42-b1da-212f4c4abffa', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee28ffb6-99, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee28ffb6-99, col_values=(('qos', UUID('4b898fbe-b556-4f91-b8ad-a73e86fff88a')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee28ffb6-99, col_values=(('external_ids', {'iface-id': 'ee28ffb6-999b-4675-85c6-2226b726bba7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:0d:74', 'vm-uuid': 'b511b968-5c5b-4c17-9d14-cccc3bc7d7e6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: INFO os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0d:74,bridge_name='br-int',has_traffic_filtering=True,id=ee28ffb6-999b-4675-85c6-2226b726bba7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee28ffb6-99')
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:02:d1,bridge_name='br-int',has_traffic_filtering=True,id=798cf9c6-2c78-4f74-8a69-2ea7d378fc43,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf9c6-2c') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:02:d1,bridge_name='br-int',has_traffic_filtering=True,id=798cf9c6-2c78-4f74-8a69-2ea7d378fc43,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf9c6-2c') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21fa320f-dca1-5a6b-810c-24bc4835033f', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap798cf9c6-2c, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap798cf9c6-2c, col_values=(('qos', UUID('3d664ac4-6b2c-4ed1-ad9e-45b316d43cd3')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap798cf9c6-2c, col_values=(('external_ids', {'iface-id': '798cf9c6-2c78-4f74-8a69-2ea7d378fc43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:02:d1', 'vm-uuid': 'b511b968-5c5b-4c17-9d14-cccc3bc7d7e6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: INFO os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:02:d1,bridge_name='br-int',has_traffic_filtering=True,id=798cf9c6-2c78-4f74-8a69-2ea7d378fc43,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf9c6-2c')
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:57,bridge_name='br-int',has_traffic_filtering=True,id=f2b47078-4add-42be-9d9b-b67f20f530d8,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b47078-4a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:57,bridge_name='br-int',has_traffic_filtering=True,id=f2b47078-4add-42be-9d9b-b67f20f530d8,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b47078-4a') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7ea750a-60e2-5e37-99d6-bda9bd7232cb', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2b47078-4a, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2b47078-4a, col_values=(('qos', UUID('32780ac4-e988-4380-91e9-a9d144a4219a')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2b47078-4a, col_values=(('external_ids', {'iface-id': 'f2b47078-4add-42be-9d9b-b67f20f530d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:62:57', 'vm-uuid': 'b511b968-5c5b-4c17-9d14-cccc3bc7d7e6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:17 user nova-compute[75260]: INFO os_vif [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:57,bridge_name='br-int',has_traffic_filtering=True,id=f2b47078-4add-42be-9d9b-b67f20f530d8,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b47078-4a')
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] No BDM found with device name hda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] No VIF found with MAC fa:16:3e:ae:77:22, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] No VIF found with MAC fa:16:3e:b5:0d:74, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:40:17 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Using config drive
Nov 27 04:40:17 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Creating config drive at /opt/stack/data/nova/instances/b511b968-5c5b-4c17-9d14-cccc3bc7d7e6/disk.config
Nov 27 04:40:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b511b968-5c5b-4c17-9d14-cccc3bc7d7e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy1igiezc {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b511b968-5c5b-4c17-9d14-cccc3bc7d7e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy1igiezc" returned: 0 in 0.067s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:40:19 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Creating image(s)
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Ensure instance console log exists: /opt/stack/data/nova/instances/46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Start _get_guest_xml network_info=[{"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '983182e3-724d-4e5e-8cc3-21e910f386e7', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZdrevfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80', 'attached_at': '', 'detached_at': '', 'volume_id': '40109f1d-f8a9-406e-aa0a-a7e8d53c97b0', 'serial': '40109f1d-f8a9-406e-aa0a-a7e8d53c97b0'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}, {'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '6de0a91a-1304-4bc1-8818-11d3055b026c', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLdJqzcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80', 'attached_at': '', 'detached_at': '', 'volume_id': '409251ea-c7b3-458d-bd21-c589313b2ad9', 'serial': '409251ea-c7b3-458d-bd21-c589313b2ad9'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 1, 'volume_type': None}, {'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': 'c567ae1a-fa64-4ad7-ae7b-0a022a2d4210', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipXfmjvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba5ddc4b-44d9-4674-b31d-b481e7609898', 'serial': 'ba5ddc4b-44d9-4674-b31d-b481e7609898'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 2, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:19 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:40:19 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZdrevfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:19 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:19 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:19 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b490032b-d865-421b-a90a-50ef57b9041c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:40:19 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[111333b4-4aa6-47be-8082-6f7f443e1c5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0] added
Nov 27 04:40:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ebf8e-0bf6-4f27-b2c0-8e44a7be5e78]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c5b20d-282d-4386-b48f-0ee94fb09ce3]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZdrevfb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZdrevfb" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[967c9d87-7a32-4dcc-b2f8-adaad8710e4e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YZdrevfb'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.071s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1200cc54-9d8f-407b-a2ba-d99555bea7c1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4a68c4-ad16-46af-bf17-64bcf411148b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:19 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:19 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:19 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:19 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:19 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:19 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-30215dd5-ba54-4345-b3b0-8f239f8c497e req-12b539ea-f2a5-4897-bd3f-dedaeb4d145f service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-30215dd5-ba54-4345-b3b0-8f239f8c497e req-12b539ea-f2a5-4897-bd3f-dedaeb4d145f service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-30215dd5-ba54-4345-b3b0-8f239f8c497e req-12b539ea-f2a5-4897-bd3f-dedaeb4d145f service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-30215dd5-ba54-4345-b3b0-8f239f8c497e req-12b539ea-f2a5-4897-bd3f-dedaeb4d145f service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-30215dd5-ba54-4345-b3b0-8f239f8c497e req-12b539ea-f2a5-4897-bd3f-dedaeb4d145f service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:20 user nova-compute[75260]: WARNING nova.compute.manager [req-30215dd5-ba54-4345-b3b0-8f239f8c497e req-12b539ea-f2a5-4897-bd3f-dedaeb4d145f service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 for instance with vm_state building and task_state spawning.
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f52569-b5b6-42d2-baa4-eda3a1aac6dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0, portal: 172.16.0.220,3260]
Nov 27 04:40:20 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0, portal: 172.16.0.220,3260] successful.
Nov 27 04:40:20 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4733173a-0cac-4967-83b3-03cf1a1d36c0]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7160156e-ce98-4fab-8175-d25ef15655e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:20 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:20 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:20 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:20 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:20 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:20 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:20 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:20 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:20 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:20 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb56f5d-c3c8-43e2-a1fe-18e8b1849816]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-b86a1872-582f-4959-bc41-86e36afdd3e9 req-df3ff2d5-e93b-419e-963c-b7b53282a1fc service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b86a1872-582f-4959-bc41-86e36afdd3e9 req-df3ff2d5-e93b-419e-963c-b7b53282a1fc service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b86a1872-582f-4959-bc41-86e36afdd3e9 req-df3ff2d5-e93b-419e-963c-b7b53282a1fc service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b86a1872-582f-4959-bc41-86e36afdd3e9 req-df3ff2d5-e93b-419e-963c-b7b53282a1fc service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-b86a1872-582f-4959-bc41-86e36afdd3e9 req-df3ff2d5-e93b-419e-963c-b7b53282a1fc service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:20 user nova-compute[75260]: WARNING nova.compute.manager [req-b86a1872-582f-4959-bc41-86e36afdd3e9 req-df3ff2d5-e93b-419e-963c-b7b53282a1fc service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c for instance with vm_state building and task_state spawning.
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZdrevfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '23636656331396137', 'path': '/dev/sdf'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636656331396137', 'path': '/dev/sdf'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLdJqzcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:21 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:21 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:21 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d4ecbb-696d-4e0c-8ed6-0aaeaba9db9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:40:21 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d413a4b-2ddd-4e42-86b4-765eb1b32eec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9] added
Nov 27 04:40:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff50065a-dd77-4bc7-9002-3ff1f25f9f24]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c4c520-0181-43f9-acc4-36a1696c6f7b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLdJqzcD {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLdJqzcD" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[573551ab-6f6d-40d9-b6b5-e1d9c6ac2ee1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QLdJqzcD'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5bda1a-0dc8-4b21-a760-82e15d90408e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0b26b7-1a3c-4bc3-acd6-979c84608708]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ade5fbb-a0cd-4a2b-8333-6785041e3616]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9, portal: 172.16.0.220,3260]
Nov 27 04:40:21 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9, portal: 172.16.0.220,3260] successful.
Nov 27 04:40:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d44676-b202-45d6-9779-7f669e9638bd]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[de03cd97-7cda-40e5-92ba-35bbbb35515c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:21 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f22969-71d5-4d92-911a-02daf4149c2e]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLdJqzcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-ee28ffb6-999b-4675-85c6-2226b726bba7 for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-ecc48b16-3c52-4763-b5b4-46145aabeb65 req-6dde11dd-e00e-4d95-b0bb-28955ee7aa30 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-ee28ffb6-999b-4675-85c6-2226b726bba7 for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ec19d11f-5d9b-492c-9ff5-713c00b0b4d3 req-b07141f9-2b52-4c66-8273-ba4a94d63320 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ec19d11f-5d9b-492c-9ff5-713c00b0b4d3 req-b07141f9-2b52-4c66-8273-ba4a94d63320 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ec19d11f-5d9b-492c-9ff5-713c00b0b4d3 req-b07141f9-2b52-4c66-8273-ba4a94d63320 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ec19d11f-5d9b-492c-9ff5-713c00b0b4d3 req-b07141f9-2b52-4c66-8273-ba4a94d63320 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-ec19d11f-5d9b-492c-9ff5-713c00b0b4d3 req-b07141f9-2b52-4c66-8273-ba4a94d63320 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-ec19d11f-5d9b-492c-9ff5-713c00b0b4d3 req-b07141f9-2b52-4c66-8273-ba4a94d63320 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-f2b47078-4add-42be-9d9b-b67f20f530d8 for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING nova.compute.manager [req-40e0d7f8-ab88-491e-adee-cff52b590c34 req-b6b2c56f-3139-410f-8181-4811753e42a8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 for instance with vm_state building and task_state spawning.
Nov 27 04:40:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23836336163346635', 'path': '/dev/sdg'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836336163346635', 'path': '/dev/sdg'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipXfmjvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:22 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:22 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cca6b53-f10c-4db5-8a69-d81ea38f2bf8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:40:22 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca20b94b-9d98-4240-a018-5442bb9fe7db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898] added
Nov 27 04:40:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b912035-c2b2-4c46-867d-6c7832895882]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[69001af1-2dca-447c-bd60-71cfc9598548]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipXfmjvH {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipXfmjvH" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4fdc57-896c-4cf8-bc8f-da64968e34f4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ipXfmjvH'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c37d65e-0c85-4e19-bee0-9651280408eb]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d95b96-ed62-4499-8569-94bbc5571d29]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:22 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:22 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:22 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:22 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:22 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:22 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:22 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:22 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:22 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:22 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc1b35e-d517-4783-89dc-d9d7c97e0d9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898, portal: 172.16.0.220,3260]
Nov 27 04:40:22 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898, portal: 172.16.0.220,3260] successful.
Nov 27 04:40:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ce9f56-c4c7-4c79-bc96-735d34a9cf97]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e0bf07-d473-437c-a806-ea96c101bcd3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:40:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:23 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:40:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e11eaf-761f-49c6-8770-4961389e2dda]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipXfmjvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23261326565373239', 'path': '/dev/sdh'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261326565373239', 'path': '/dev/sdh'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:b4,bridge_name='br-int',has_traffic_filtering=True,id=eeb0783a-b889-41cc-bf3d-7860e57b193d,network=Network(35c8ce4f-455b-44f5-9b0f-8e592696b3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0783a-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:b3,bridge_name='br-int',has_traffic_filtering=True,id=2de06c44-2283-4cdb-bf1f-962fdd3053a1,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de06c44-22') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:c8:96,bridge_name='br-int',has_traffic_filtering=True,id=a62d1e1d-4a02-44b5-802f-114dc6320858,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa62d1e1d-4a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:5c:cd,bridge_name='br-int',has_traffic_filtering=True,id=0ad3d43a-6008-4f21-a1a2-6aec72523960,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad3d43a-60') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:75,bridge_name='br-int',has_traffic_filtering=True,id=06fc3d26-c623-4672-8580-0403fad18d83,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fc3d26-c6') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:58:f1,bridge_name='br-int',has_traffic_filtering=True,id=6bf9d769-b7d2-48dc-9254-f10f32c7f632,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf9d769-b7') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:4c,bridge_name='br-int',has_traffic_filtering=True,id=e3182588-d313-45c7-981c-25ff46efdae8,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3182588-d3') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.objects.instance [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lazy-loading 'pci_devices' on Instance uuid 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:40:24 user nova-compute[75260]:   <uuid>46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80</uuid>
Nov 27 04:40:24 user nova-compute[75260]:   <name>instance-0000000c</name>
Nov 27 04:40:24 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:40:24 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:40:24 user nova-compute[75260]:   <metadata>
Nov 27 04:40:24 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:40:24 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:40:24 user nova-compute[75260]:       <nova:name>tempest-device-tagging-server-110546189</nova:name>
Nov 27 04:40:24 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:40:19</nova:creationTime>
Nov 27 04:40:24 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:40:24 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:40:24 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:40:24 user nova-compute[75260]:       <nova:owner>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:user uuid="43d426d6a5284e34a2cf5246ad52e210">tempest-TaggedBootDevicesTest-1225676720-project-member</nova:user>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:project uuid="fc40027c0fdd4916b1a43367e9984462">tempest-TaggedBootDevicesTest-1225676720</nova:project>
Nov 27 04:40:24 user nova-compute[75260]:       </nova:owner>
Nov 27 04:40:24 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:40:24 user nova-compute[75260]:       <nova:ports>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:port uuid="eeb0783a-b889-41cc-bf3d-7860e57b193d">
Nov 27 04:40:24 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 04:40:24 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:port uuid="2de06c44-2283-4cdb-bf1f-962fdd3053a1">
Nov 27 04:40:24 user nova-compute[75260]:           <nova:ip type="fixed" address="10.1.1.149" ipVersion="4"/>
Nov 27 04:40:24 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:port uuid="a62d1e1d-4a02-44b5-802f-114dc6320858">
Nov 27 04:40:24 user nova-compute[75260]:           <nova:ip type="fixed" address="10.1.1.51" ipVersion="4"/>
Nov 27 04:40:24 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:port uuid="0ad3d43a-6008-4f21-a1a2-6aec72523960">
Nov 27 04:40:24 user nova-compute[75260]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Nov 27 04:40:24 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:port uuid="06fc3d26-c623-4672-8580-0403fad18d83">
Nov 27 04:40:24 user nova-compute[75260]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Nov 27 04:40:24 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:port uuid="6bf9d769-b7d2-48dc-9254-f10f32c7f632">
Nov 27 04:40:24 user nova-compute[75260]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 27 04:40:24 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:24 user nova-compute[75260]:         <nova:port uuid="e3182588-d313-45c7-981c-25ff46efdae8">
Nov 27 04:40:24 user nova-compute[75260]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 27 04:40:24 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:24 user nova-compute[75260]:       </nova:ports>
Nov 27 04:40:24 user nova-compute[75260]:     </nova:instance>
Nov 27 04:40:24 user nova-compute[75260]:   </metadata>
Nov 27 04:40:24 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:40:24 user nova-compute[75260]:     <system>
Nov 27 04:40:24 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:40:24 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:40:24 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:40:24 user nova-compute[75260]:       <entry name="serial">46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80</entry>
Nov 27 04:40:24 user nova-compute[75260]:       <entry name="uuid">46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80</entry>
Nov 27 04:40:24 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:40:24 user nova-compute[75260]:     </system>
Nov 27 04:40:24 user nova-compute[75260]:   </sysinfo>
Nov 27 04:40:24 user nova-compute[75260]:   <os>
Nov 27 04:40:24 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:40:24 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:40:24 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:40:24 user nova-compute[75260]:   </os>
Nov 27 04:40:24 user nova-compute[75260]:   <features>
Nov 27 04:40:24 user nova-compute[75260]:     <acpi/>
Nov 27 04:40:24 user nova-compute[75260]:     <apic/>
Nov 27 04:40:24 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:40:24 user nova-compute[75260]:   </features>
Nov 27 04:40:24 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:40:24 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:40:24 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:40:24 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:40:24 user nova-compute[75260]:   </clock>
Nov 27 04:40:24 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:40:24 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:40:24 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:40:24 user nova-compute[75260]:   </cpu>
Nov 27 04:40:24 user nova-compute[75260]:   <devices>
Nov 27 04:40:24 user nova-compute[75260]:     <disk type="file" device="cdrom">
Nov 27 04:40:24 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 04:40:24 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80/disk.config"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="hda" bus="ide"/>
Nov 27 04:40:24 user nova-compute[75260]:     </disk>
Nov 27 04:40:24 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:40:24 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:40:24 user nova-compute[75260]:       <source dev="/dev/sdf"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:       <serial>40109f1d-f8a9-406e-aa0a-a7e8d53c97b0</serial>
Nov 27 04:40:24 user nova-compute[75260]:     </disk>
Nov 27 04:40:24 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:40:24 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:40:24 user nova-compute[75260]:       <source dev="/dev/sdg"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:       <serial>409251ea-c7b3-458d-bd21-c589313b2ad9</serial>
Nov 27 04:40:24 user nova-compute[75260]:     </disk>
Nov 27 04:40:24 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:40:24 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:40:24 user nova-compute[75260]:       <source dev="/dev/sdh"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="vdc" bus="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:       <serial>ba5ddc4b-44d9-4674-b31d-b481e7609898</serial>
Nov 27 04:40:24 user nova-compute[75260]:     </disk>
Nov 27 04:40:24 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:24 user nova-compute[75260]:       <mac address="fa:16:3e:82:bc:b4"/>
Nov 27 04:40:24 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="tapeeb0783a-b8"/>
Nov 27 04:40:24 user nova-compute[75260]:     </interface>
Nov 27 04:40:24 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:24 user nova-compute[75260]:       <mac address="fa:16:3e:37:11:b3"/>
Nov 27 04:40:24 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="tap2de06c44-22"/>
Nov 27 04:40:24 user nova-compute[75260]:     </interface>
Nov 27 04:40:24 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:24 user nova-compute[75260]:       <mac address="fa:16:3e:25:c8:96"/>
Nov 27 04:40:24 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="tapa62d1e1d-4a"/>
Nov 27 04:40:24 user nova-compute[75260]:     </interface>
Nov 27 04:40:24 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:24 user nova-compute[75260]:       <mac address="fa:16:3e:f7:5c:cd"/>
Nov 27 04:40:24 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="tap0ad3d43a-60"/>
Nov 27 04:40:24 user nova-compute[75260]:     </interface>
Nov 27 04:40:24 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:24 user nova-compute[75260]:       <mac address="fa:16:3e:f7:47:75"/>
Nov 27 04:40:24 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="tap06fc3d26-c6"/>
Nov 27 04:40:24 user nova-compute[75260]:     </interface>
Nov 27 04:40:24 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:24 user nova-compute[75260]:       <mac address="fa:16:3e:36:58:f1"/>
Nov 27 04:40:24 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="tap6bf9d769-b7"/>
Nov 27 04:40:24 user nova-compute[75260]:     </interface>
Nov 27 04:40:24 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:24 user nova-compute[75260]:       <mac address="fa:16:3e:cd:e9:4c"/>
Nov 27 04:40:24 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:24 user nova-compute[75260]:       <target dev="tape3182588-d3"/>
Nov 27 04:40:24 user nova-compute[75260]:     </interface>
Nov 27 04:40:24 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:40:24 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80/console.log" append="off"/>
Nov 27 04:40:24 user nova-compute[75260]:     </serial>
Nov 27 04:40:24 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:40:24 user nova-compute[75260]:     <video>
Nov 27 04:40:24 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:24 user nova-compute[75260]:     </video>
Nov 27 04:40:24 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:40:24 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:40:24 user nova-compute[75260]:     </rng>
Nov 27 04:40:24 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:40:24 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:40:24 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:40:24 user nova-compute[75260]:     </memballoon>
Nov 27 04:40:24 user nova-compute[75260]:   </devices>
Nov 27 04:40:24 user nova-compute[75260]: </domain>
Nov 27 04:40:24 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:b4,bridge_name='br-int',has_traffic_filtering=True,id=eeb0783a-b889-41cc-bf3d-7860e57b193d,network=Network(35c8ce4f-455b-44f5-9b0f-8e592696b3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0783a-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:b4,bridge_name='br-int',has_traffic_filtering=True,id=eeb0783a-b889-41cc-bf3d-7860e57b193d,network=Network(35c8ce4f-455b-44f5-9b0f-8e592696b3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0783a-b8') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-73409b6d-1f77-40ab-b5d6-f335843f64d7 req-6b86184c-de70-46d7-b390-0d7adec6c0d9 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-73409b6d-1f77-40ab-b5d6-f335843f64d7 req-6b86184c-de70-46d7-b390-0d7adec6c0d9 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-73409b6d-1f77-40ab-b5d6-f335843f64d7 req-6b86184c-de70-46d7-b390-0d7adec6c0d9 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-73409b6d-1f77-40ab-b5d6-f335843f64d7 req-6b86184c-de70-46d7-b390-0d7adec6c0d9 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-73409b6d-1f77-40ab-b5d6-f335843f64d7 req-6b86184c-de70-46d7-b390-0d7adec6c0d9 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:24 user nova-compute[75260]: WARNING nova.compute.manager [req-73409b6d-1f77-40ab-b5d6-f335843f64d7 req-6b86184c-de70-46d7-b390-0d7adec6c0d9 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-f2b47078-4add-42be-9d9b-b67f20f530d8 for instance with vm_state building and task_state spawning.
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c769af5e-7fe6-57b3-a690-78d011b3e316', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeb0783a-b8, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeeb0783a-b8, col_values=(('qos', UUID('fd657673-ed36-46d1-9627-da2ec9eef25b')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeeb0783a-b8, col_values=(('external_ids', {'iface-id': 'eeb0783a-b889-41cc-bf3d-7860e57b193d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:bc:b4', 'vm-uuid': '46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.compute.manager [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: INFO os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:bc:b4,bridge_name='br-int',has_traffic_filtering=True,id=eeb0783a-b889-41cc-bf3d-7860e57b193d,network=Network(35c8ce4f-455b-44f5-9b0f-8e592696b3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0783a-b8')
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:b3,bridge_name='br-int',has_traffic_filtering=True,id=2de06c44-2283-4cdb-bf1f-962fdd3053a1,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de06c44-22') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:b3,bridge_name='br-int',has_traffic_filtering=True,id=2de06c44-2283-4cdb-bf1f-962fdd3053a1,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de06c44-22') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45a3717c-93b5-55f5-b00f-199e8952880e', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Instance spawned successfully.
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2de06c44-22, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2de06c44-22, col_values=(('qos', UUID('2a0bdff1-61d2-4324-81d9-e3ff1e6ed24f')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2de06c44-22, col_values=(('external_ids', {'iface-id': '2de06c44-2283-4cdb-bf1f-962fdd3053a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:11:b3', 'vm-uuid': '46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: INFO os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:b3,bridge_name='br-int',has_traffic_filtering=True,id=2de06c44-2283-4cdb-bf1f-962fdd3053a1,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de06c44-22')
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:c8:96,bridge_name='br-int',has_traffic_filtering=True,id=a62d1e1d-4a02-44b5-802f-114dc6320858,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa62d1e1d-4a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:c8:96,bridge_name='br-int',has_traffic_filtering=True,id=a62d1e1d-4a02-44b5-802f-114dc6320858,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa62d1e1d-4a') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '399fc864-1025-56f0-b52c-c41166bfc3ed', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa62d1e1d-4a, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa62d1e1d-4a, col_values=(('qos', UUID('60fb316d-d9e4-4a37-9d37-a433ae07edcc')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa62d1e1d-4a, col_values=(('external_ids', {'iface-id': 'a62d1e1d-4a02-44b5-802f-114dc6320858', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:c8:96', 'vm-uuid': '46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: INFO os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:c8:96,bridge_name='br-int',has_traffic_filtering=True,id=a62d1e1d-4a02-44b5-802f-114dc6320858,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa62d1e1d-4a')
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:5c:cd,bridge_name='br-int',has_traffic_filtering=True,id=0ad3d43a-6008-4f21-a1a2-6aec72523960,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad3d43a-60') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:5c:cd,bridge_name='br-int',has_traffic_filtering=True,id=0ad3d43a-6008-4f21-a1a2-6aec72523960,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad3d43a-60') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa1739c6-8318-5f7a-b6c0-33fce31654f8', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: INFO nova.compute.manager [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Took 11.61 seconds to spawn the instance on the hypervisor.
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.compute.manager [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ad3d43a-60, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ad3d43a-60, col_values=(('qos', UUID('b7d094e8-e9ba-4af1-94d2-840d1fda543b')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ad3d43a-60, col_values=(('external_ids', {'iface-id': '0ad3d43a-6008-4f21-a1a2-6aec72523960', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:5c:cd', 'vm-uuid': '46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: INFO os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:5c:cd,bridge_name='br-int',has_traffic_filtering=True,id=0ad3d43a-6008-4f21-a1a2-6aec72523960,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad3d43a-60')
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:75,bridge_name='br-int',has_traffic_filtering=True,id=06fc3d26-c623-4672-8580-0403fad18d83,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fc3d26-c6') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:75,bridge_name='br-int',has_traffic_filtering=True,id=06fc3d26-c623-4672-8580-0403fad18d83,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fc3d26-c6') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2888e56a-f483-5bdb-bd22-26591298f16d', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06fc3d26-c6, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06fc3d26-c6, col_values=(('qos', UUID('e76c78c0-bf82-4d1e-8833-4760d655d823')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06fc3d26-c6, col_values=(('external_ids', {'iface-id': '06fc3d26-c623-4672-8580-0403fad18d83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:47:75', 'vm-uuid': '46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: INFO nova.compute.manager [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Took 34.49 seconds to build instance.
Nov 27 04:40:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-af337f3a-3e5d-4d2f-8bd1-5ea3788af661 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.634s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: INFO os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:75,bridge_name='br-int',has_traffic_filtering=True,id=06fc3d26-c623-4672-8580-0403fad18d83,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fc3d26-c6')
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:58:f1,bridge_name='br-int',has_traffic_filtering=True,id=6bf9d769-b7d2-48dc-9254-f10f32c7f632,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf9d769-b7') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:58:f1,bridge_name='br-int',has_traffic_filtering=True,id=6bf9d769-b7d2-48dc-9254-f10f32c7f632,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf9d769-b7') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af1fdb87-1d2a-509e-95c6-a3b7f9449cf8', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bf9d769-b7, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bf9d769-b7, col_values=(('qos', UUID('dca604e8-a9dd-4cf1-b327-821b9a7e5ac5')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bf9d769-b7, col_values=(('external_ids', {'iface-id': '6bf9d769-b7d2-48dc-9254-f10f32c7f632', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:58:f1', 'vm-uuid': '46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: INFO os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:58:f1,bridge_name='br-int',has_traffic_filtering=True,id=6bf9d769-b7d2-48dc-9254-f10f32c7f632,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf9d769-b7')
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:4c,bridge_name='br-int',has_traffic_filtering=True,id=e3182588-d313-45c7-981c-25ff46efdae8,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3182588-d3') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:4c,bridge_name='br-int',has_traffic_filtering=True,id=e3182588-d313-45c7-981c-25ff46efdae8,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3182588-d3') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8d9a383-45c0-57d1-bea6-5b27d89b8c73', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3182588-d3, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3182588-d3, col_values=(('qos', UUID('8b3eb1e5-fbe3-4307-a0cc-97530ead1c0f')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3182588-d3, col_values=(('external_ids', {'iface-id': 'e3182588-d313-45c7-981c-25ff46efdae8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:e9:4c', 'vm-uuid': '46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:40:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:25 user nova-compute[75260]: INFO os_vif [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:4c,bridge_name='br-int',has_traffic_filtering=True,id=e3182588-d313-45c7-981c-25ff46efdae8,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3182588-d3')
Nov 27 04:40:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] No BDM found with device name hda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:40:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:40:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] No VIF found with MAC fa:16:3e:82:bc:b4, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:40:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] No VIF found with MAC fa:16:3e:f7:47:75, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:40:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Using config drive
Nov 27 04:40:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Creating config drive at /opt/stack/data/nova/instances/46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80/disk.config
Nov 27 04:40:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph91yyxue {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph91yyxue" returned: 0 in 0.058s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-bf6c621a-b670-4cb9-855b-ba24e5376a1c req-a9d89dc0-f331-4a5a-9910-6a275b14d484 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bf6c621a-b670-4cb9-855b-ba24e5376a1c req-a9d89dc0-f331-4a5a-9910-6a275b14d484 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bf6c621a-b670-4cb9-855b-ba24e5376a1c req-a9d89dc0-f331-4a5a-9910-6a275b14d484 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bf6c621a-b670-4cb9-855b-ba24e5376a1c req-a9d89dc0-f331-4a5a-9910-6a275b14d484 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-bf6c621a-b670-4cb9-855b-ba24e5376a1c req-a9d89dc0-f331-4a5a-9910-6a275b14d484 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:27 user nova-compute[75260]: WARNING nova.compute.manager [req-bf6c621a-b670-4cb9-855b-ba24e5376a1c req-a9d89dc0-f331-4a5a-9910-6a275b14d484 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-eeb0783a-b889-41cc-bf3d-7860e57b193d for instance with vm_state building and task_state spawning.
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-00d7039d-d129-4fb5-a83b-d5e3717ee2c2 req-9a0dc84c-2627-40be-83d4-5ea01e611fd3 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-00d7039d-d129-4fb5-a83b-d5e3717ee2c2 req-9a0dc84c-2627-40be-83d4-5ea01e611fd3 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-00d7039d-d129-4fb5-a83b-d5e3717ee2c2 req-9a0dc84c-2627-40be-83d4-5ea01e611fd3 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-00d7039d-d129-4fb5-a83b-d5e3717ee2c2 req-9a0dc84c-2627-40be-83d4-5ea01e611fd3 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-00d7039d-d129-4fb5-a83b-d5e3717ee2c2 req-9a0dc84c-2627-40be-83d4-5ea01e611fd3 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:27 user nova-compute[75260]: WARNING nova.compute.manager [req-00d7039d-d129-4fb5-a83b-d5e3717ee2c2 req-9a0dc84c-2627-40be-83d4-5ea01e611fd3 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-a62d1e1d-4a02-44b5-802f-114dc6320858 for instance with vm_state building and task_state spawning.
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-cc15f178-22dd-4ce2-8c16-70045078a89b req-32b71abd-8b5d-47e1-a5aa-e6ac14c4255a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cc15f178-22dd-4ce2-8c16-70045078a89b req-32b71abd-8b5d-47e1-a5aa-e6ac14c4255a service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cc15f178-22dd-4ce2-8c16-70045078a89b req-32b71abd-8b5d-47e1-a5aa-e6ac14c4255a service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cc15f178-22dd-4ce2-8c16-70045078a89b req-32b71abd-8b5d-47e1-a5aa-e6ac14c4255a service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-cc15f178-22dd-4ce2-8c16-70045078a89b req-32b71abd-8b5d-47e1-a5aa-e6ac14c4255a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:28 user nova-compute[75260]: WARNING nova.compute.manager [req-cc15f178-22dd-4ce2-8c16-70045078a89b req-32b71abd-8b5d-47e1-a5aa-e6ac14c4255a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-06fc3d26-c623-4672-8580-0403fad18d83 for instance with vm_state building and task_state spawning.
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:29 user nova-compute[75260]: WARNING nova.compute.manager [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-eeb0783a-b889-41cc-bf3d-7860e57b193d for instance with vm_state building and task_state spawning.
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:29 user nova-compute[75260]: WARNING nova.compute.manager [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 for instance with vm_state building and task_state spawning.
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:29 user nova-compute[75260]: WARNING nova.compute.manager [req-6578b632-2e3f-4254-a7e1-8305df3f9f0c req-1d153912-aa37-4f2c-94df-d5c610c04f3a service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 for instance with vm_state building and task_state spawning.
Nov 27 04:40:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:29 user nova-compute[75260]: WARNING nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-a62d1e1d-4a02-44b5-802f-114dc6320858 for instance with vm_state building and task_state spawning.
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:29 user nova-compute[75260]: WARNING nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 for instance with vm_state building and task_state spawning.
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:29 user nova-compute[75260]: WARNING nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 for instance with vm_state building and task_state spawning.
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:29 user nova-compute[75260]: WARNING nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 for instance with vm_state building and task_state spawning.
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:29 user nova-compute[75260]: WARNING nova.compute.manager [req-369fee21-2996-4a4b-b918-71080d27306a req-3d6717c1-b098-4cd1-8192-d3e44f3786f5 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 for instance with vm_state building and task_state spawning.
Nov 27 04:40:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:30 user nova-compute[75260]: WARNING nova.compute.manager [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-06fc3d26-c623-4672-8580-0403fad18d83 for instance with vm_state building and task_state spawning.
Nov 27 04:40:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:30 user nova-compute[75260]: WARNING nova.compute.manager [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-e3182588-d313-45c7-981c-25ff46efdae8 for instance with vm_state building and task_state spawning.
Nov 27 04:40:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:30 user nova-compute[75260]: WARNING nova.compute.manager [req-ae7ac071-7d71-4e31-a30b-80058e91bf17 req-5c83267f-3ef8-4c21-879e-b2260b42097b service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-e3182588-d313-45c7-981c-25ff46efdae8 for instance with vm_state building and task_state spawning.
Nov 27 04:40:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:31 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:40:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:40:31 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Instance spawned successfully.
Nov 27 04:40:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:40:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:40:31 user nova-compute[75260]: INFO nova.compute.manager [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Took 11.95 seconds to spawn the instance on the hypervisor.
Nov 27 04:40:31 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:40:31 user nova-compute[75260]: INFO nova.compute.manager [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Took 39.40 seconds to build instance.
Nov 27 04:40:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5a08d232-9160-4b39-b83f-285b6ba5799f tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.507s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:40:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:40:33 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:40:34 user nova-compute[75260]: INFO nova.compute.manager [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Rescuing
Nov 27 04:40:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquired lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:34 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:40:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:40:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updating instance_info_cache with network_info: [{"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Releasing lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG nova.compute.manager [req-0909f6cf-f37c-4767-b051-141a03b6890d req-764c98da-4756-4cda-a07d-b7dd81208989 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-vif-unplugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0909f6cf-f37c-4767-b051-141a03b6890d req-764c98da-4756-4cda-a07d-b7dd81208989 service nova] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0909f6cf-f37c-4767-b051-141a03b6890d req-764c98da-4756-4cda-a07d-b7dd81208989 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0909f6cf-f37c-4767-b051-141a03b6890d req-764c98da-4756-4cda-a07d-b7dd81208989 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG nova.compute.manager [req-0909f6cf-f37c-4767-b051-141a03b6890d req-764c98da-4756-4cda-a07d-b7dd81208989 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] No waiting events found dispatching network-vif-unplugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:35 user nova-compute[75260]: WARNING nova.compute.manager [req-0909f6cf-f37c-4767-b051-141a03b6890d req-764c98da-4756-4cda-a07d-b7dd81208989 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received unexpected event network-vif-unplugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e for instance with vm_state active and task_state rescuing.
Nov 27 04:40:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:40:35 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Instance destroyed successfully.
Nov 27 04:40:35 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Attempting rescue
Nov 27 04:40:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75260) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Instance directory exists: not creating {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 04:40:35 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Creating image(s)
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:35 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'trusted_certs' on Instance uuid d8cd1732-d408-4ef3-85b6-94b12ba7f5ad {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.302s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue" returned: 0 in 0.046s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'migration_context' on Instance uuid d8cd1732-d408-4ef3-85b6-94b12ba7f5ad {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json" returned: 0 in 0.551s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.objects.base [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<d8cd1732-d408-4ef3-85b6-94b12ba7f5ad> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Start _get_guest_xml network_info=[{"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "vif_mac": "fa:16:3e:b1:85:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'resources' on Instance uuid d8cd1732-d408-4ef3-85b6-94b12ba7f5ad {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.objects.base [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<d8cd1732-d408-4ef3-85b6-94b12ba7f5ad> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'numa_topology' on Instance uuid d8cd1732-d408-4ef3-85b6-94b12ba7f5ad {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.objects.base [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<d8cd1732-d408-4ef3-85b6-94b12ba7f5ad> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:40:36 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:40:36 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'vcpu_model' on Instance uuid d8cd1732-d408-4ef3-85b6-94b12ba7f5ad {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.objects.base [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<d8cd1732-d408-4ef3-85b6-94b12ba7f5ad> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-802958880',display_name='tempest-ServerRescueNegativeTestJSON-server-802958880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-802958880',id=2,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:38:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-hpfh43sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:57Z,user_data=None,user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=d8cd1732-d408-4ef3-85b6-94b12ba7f5ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "vif_mac": "fa:16:3e:b1:85:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "vif_mac": "fa:16:3e:b1:85:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:85:32,bridge_name='br-int',has_traffic_filtering=True,id=3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9a12f-82') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'pci_devices' on Instance uuid d8cd1732-d408-4ef3-85b6-94b12ba7f5ad {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.objects.base [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<d8cd1732-d408-4ef3-85b6-94b12ba7f5ad> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:40:36 user nova-compute[75260]:   <uuid>d8cd1732-d408-4ef3-85b6-94b12ba7f5ad</uuid>
Nov 27 04:40:36 user nova-compute[75260]:   <name>instance-00000002</name>
Nov 27 04:40:36 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:40:36 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:40:36 user nova-compute[75260]:   <metadata>
Nov 27 04:40:36 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:40:36 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:40:36 user nova-compute[75260]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-802958880</nova:name>
Nov 27 04:40:36 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:40:36</nova:creationTime>
Nov 27 04:40:36 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:40:36 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:40:36 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:40:36 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:40:36 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:40:36 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:40:36 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:40:36 user nova-compute[75260]:       <nova:owner>
Nov 27 04:40:36 user nova-compute[75260]:         <nova:user uuid="41069f4d1d404da19dcfb2a3552fcddb">tempest-ServerRescueNegativeTestJSON-1319145768-project-member</nova:user>
Nov 27 04:40:36 user nova-compute[75260]:         <nova:project uuid="0e5f7694b2294e16aec0248f1217b148">tempest-ServerRescueNegativeTestJSON-1319145768</nova:project>
Nov 27 04:40:36 user nova-compute[75260]:       </nova:owner>
Nov 27 04:40:36 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:40:36 user nova-compute[75260]:       <nova:ports>
Nov 27 04:40:36 user nova-compute[75260]:         <nova:port uuid="3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e">
Nov 27 04:40:36 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 04:40:36 user nova-compute[75260]:         </nova:port>
Nov 27 04:40:36 user nova-compute[75260]:       </nova:ports>
Nov 27 04:40:36 user nova-compute[75260]:     </nova:instance>
Nov 27 04:40:36 user nova-compute[75260]:   </metadata>
Nov 27 04:40:36 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:40:36 user nova-compute[75260]:     <system>
Nov 27 04:40:36 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:40:36 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:40:36 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:40:36 user nova-compute[75260]:       <entry name="serial">d8cd1732-d408-4ef3-85b6-94b12ba7f5ad</entry>
Nov 27 04:40:36 user nova-compute[75260]:       <entry name="uuid">d8cd1732-d408-4ef3-85b6-94b12ba7f5ad</entry>
Nov 27 04:40:36 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:40:36 user nova-compute[75260]:     </system>
Nov 27 04:40:36 user nova-compute[75260]:   </sysinfo>
Nov 27 04:40:36 user nova-compute[75260]:   <os>
Nov 27 04:40:36 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:40:36 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:40:36 user nova-compute[75260]:   </os>
Nov 27 04:40:36 user nova-compute[75260]:   <features>
Nov 27 04:40:36 user nova-compute[75260]:     <acpi/>
Nov 27 04:40:36 user nova-compute[75260]:     <apic/>
Nov 27 04:40:36 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:40:36 user nova-compute[75260]:   </features>
Nov 27 04:40:36 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:40:36 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:40:36 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:40:36 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:40:36 user nova-compute[75260]:   </clock>
Nov 27 04:40:36 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:40:36 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:40:36 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:40:36 user nova-compute[75260]:   </cpu>
Nov 27 04:40:36 user nova-compute[75260]:   <devices>
Nov 27 04:40:36 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:40:36 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:40:36 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue"/>
Nov 27 04:40:36 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:40:36 user nova-compute[75260]:     </disk>
Nov 27 04:40:36 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:40:36 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:40:36 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk"/>
Nov 27 04:40:36 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:40:36 user nova-compute[75260]:     </disk>
Nov 27 04:40:36 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:40:36 user nova-compute[75260]:       <mac address="fa:16:3e:b1:85:32"/>
Nov 27 04:40:36 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:36 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:40:36 user nova-compute[75260]:       <target dev="tap3ba9a12f-82"/>
Nov 27 04:40:36 user nova-compute[75260]:     </interface>
Nov 27 04:40:36 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:40:36 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/console.log" append="off"/>
Nov 27 04:40:36 user nova-compute[75260]:     </serial>
Nov 27 04:40:36 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:40:36 user nova-compute[75260]:     <video>
Nov 27 04:40:36 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:40:36 user nova-compute[75260]:     </video>
Nov 27 04:40:36 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:40:36 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:40:36 user nova-compute[75260]:     </rng>
Nov 27 04:40:36 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:40:36 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:40:36 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:40:36 user nova-compute[75260]:     </memballoon>
Nov 27 04:40:36 user nova-compute[75260]:   </devices>
Nov 27 04:40:36 user nova-compute[75260]: </domain>
Nov 27 04:40:36 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:40:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Instance destroyed successfully.
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No VIF found with MAC fa:16:3e:b1:85:32, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-45bcc7a0-527b-4231-a87a-ddd2e69a0fe0 req-2399bad7-5d6f-47f2-aa00-120e1e28b398 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-45bcc7a0-527b-4231-a87a-ddd2e69a0fe0 req-2399bad7-5d6f-47f2-aa00-120e1e28b398 service nova] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-45bcc7a0-527b-4231-a87a-ddd2e69a0fe0 req-2399bad7-5d6f-47f2-aa00-120e1e28b398 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-45bcc7a0-527b-4231-a87a-ddd2e69a0fe0 req-2399bad7-5d6f-47f2-aa00-120e1e28b398 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-45bcc7a0-527b-4231-a87a-ddd2e69a0fe0 req-2399bad7-5d6f-47f2-aa00-120e1e28b398 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] No waiting events found dispatching network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:37 user nova-compute[75260]: WARNING nova.compute.manager [req-45bcc7a0-527b-4231-a87a-ddd2e69a0fe0 req-2399bad7-5d6f-47f2-aa00-120e1e28b398 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received unexpected event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e for instance with vm_state active and task_state rescuing.
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:40:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] No waiting events found dispatching network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:39 user nova-compute[75260]: WARNING nova.compute.manager [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received unexpected event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e for instance with vm_state active and task_state rescuing.
Nov 27 04:40:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] No waiting events found dispatching network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:39 user nova-compute[75260]: WARNING nova.compute.manager [req-f0a59a75-b0f8-43a5-a0bd-fbd88744d6a4 req-514e281b-5116-4ca1-92a5-f80c7189b643 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received unexpected event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e for instance with vm_state active and task_state rescuing.
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b89590ee-d286-4459-aee0-8f3142d18778 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:40:41 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:40:41 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=6999MB free_disk=25.596752166748047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 12efb820-12ab-442d-a5fe-80b08f12a729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d47665e4-157a-46e2-85a3-1c5cde99db1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance cd971ad8-53b2-4088-9133-862ab89dc27e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance a5543a82-a320-4119-8d6e-0476226d619b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 6d334344-945d-4718-9fa1-1464f6d0dad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance b6bca9d4-423b-406f-b016-037b8588be5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance b511b968-5c5b-4c17-9d14-cccc3bc7d7e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:40:41 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:40:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:40:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.970s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:40:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:40:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:43 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:40:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-99eeab7b-a511-4911-a698-3755661137c6 req-98856ff9-ed17-40d9-8a4e-182bd5d661c3 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-changed-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-99eeab7b-a511-4911-a698-3755661137c6 req-98856ff9-ed17-40d9-8a4e-182bd5d661c3 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Refreshing instance network info cache due to event network-changed-e07f49c0-b893-44bf-a195-c351eadfe333. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:40:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-99eeab7b-a511-4911-a698-3755661137c6 req-98856ff9-ed17-40d9-8a4e-182bd5d661c3 service nova] Acquiring lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-99eeab7b-a511-4911-a698-3755661137c6 req-98856ff9-ed17-40d9-8a4e-182bd5d661c3 service nova] Acquired lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:43 user nova-compute[75260]: DEBUG nova.network.neutron [req-99eeab7b-a511-4911-a698-3755661137c6 req-98856ff9-ed17-40d9-8a4e-182bd5d661c3 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Refreshing network info cache for port e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updating instance_info_cache with network_info: [{"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-99eeab7b-a511-4911-a698-3755661137c6 req-98856ff9-ed17-40d9-8a4e-182bd5d661c3 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updated VIF entry in instance network info cache for port e07f49c0-b893-44bf-a195-c351eadfe333. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-99eeab7b-a511-4911-a698-3755661137c6 req-98856ff9-ed17-40d9-8a4e-182bd5d661c3 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updating instance_info_cache with network_info: [{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-99eeab7b-a511-4911-a698-3755661137c6 req-98856ff9-ed17-40d9-8a4e-182bd5d661c3 service nova] Releasing lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-30fdfd57-2c47-4a30-9a3d-9cba35a4a8e0 req-bf79d507-2faa-4b15-b788-813dd965b1f6 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received event network-changed-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-30fdfd57-2c47-4a30-9a3d-9cba35a4a8e0 req-bf79d507-2faa-4b15-b788-813dd965b1f6 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Refreshing instance network info cache due to event network-changed-f74f921d-51d0-49a1-8cc0-4bf793bec0e3. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-30fdfd57-2c47-4a30-9a3d-9cba35a4a8e0 req-bf79d507-2faa-4b15-b788-813dd965b1f6 service nova] Acquiring lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-30fdfd57-2c47-4a30-9a3d-9cba35a4a8e0 req-bf79d507-2faa-4b15-b788-813dd965b1f6 service nova] Acquired lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-30fdfd57-2c47-4a30-9a3d-9cba35a4a8e0 req-bf79d507-2faa-4b15-b788-813dd965b1f6 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Refreshing network info cache for port f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:45 user nova-compute[75260]: DEBUG nova.network.neutron [req-30fdfd57-2c47-4a30-9a3d-9cba35a4a8e0 req-bf79d507-2faa-4b15-b788-813dd965b1f6 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Updated VIF entry in instance network info cache for port f74f921d-51d0-49a1-8cc0-4bf793bec0e3. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:40:45 user nova-compute[75260]: DEBUG nova.network.neutron [req-30fdfd57-2c47-4a30-9a3d-9cba35a4a8e0 req-bf79d507-2faa-4b15-b788-813dd965b1f6 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Updating instance_info_cache with network_info: [{"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-30fdfd57-2c47-4a30-9a3d-9cba35a4a8e0 req-bf79d507-2faa-4b15-b788-813dd965b1f6 service nova] Releasing lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:46 user nova-compute[75260]: DEBUG nova.objects.instance [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:47 user nova-compute[75260]: INFO nova.compute.manager [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Attaching volume 01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa to /dev/vdb
Nov 27 04:40:47 user nova-compute[75260]: DEBUG os_brick.utils [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43e502c-c97a-4802-936d-a656dc7dad7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a30fab7-d185-4475-8ed9-78cdc08bdd4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5a4cd3-4209-4701-9bee-2c6e2e55d3fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7974bb1-acc4-4527-bc54-16f99e7c1416]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:47 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac90a19-e41f-4062-bf8d-da4b0778172d]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG os_brick.utils [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updating existing volume attachment record: bcb82cd5-7fa8-404b-8298-9efe90bb26f1 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:47 user nova-compute[75260]: DEBUG nova.objects.instance [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'flavor' on Instance uuid d47665e4-157a-46e2-85a3-1c5cde99db1a {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-630bb778-87e4-43aa-a02d-db9413cc66aa req-5b3b11d6-e850-49b0-883c-d0307f3f5cf7 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-changed-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-630bb778-87e4-43aa-a02d-db9413cc66aa req-5b3b11d6-e850-49b0-883c-d0307f3f5cf7 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Refreshing instance network info cache due to event network-changed-6cb5862a-fc82-4f80-820f-02082def752d. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-630bb778-87e4-43aa-a02d-db9413cc66aa req-5b3b11d6-e850-49b0-883c-d0307f3f5cf7 service nova] Acquiring lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-630bb778-87e4-43aa-a02d-db9413cc66aa req-5b3b11d6-e850-49b0-883c-d0307f3f5cf7 service nova] Acquired lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG nova.network.neutron [req-630bb778-87e4-43aa-a02d-db9413cc66aa req-5b3b11d6-e850-49b0-883c-d0307f3f5cf7 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Refreshing network info cache for port 6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:48 user nova-compute[75260]: INFO nova.compute.manager [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Attaching volume 07546b0b-458c-407a-8ed3-b578c807d68d to /dev/vdb
Nov 27 04:40:48 user nova-compute[75260]: DEBUG os_brick.utils [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e723a4af-78f1-491d-afda-1794afa3022e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1303e26-6a7f-4d84-85c8-3df7a4456712]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5190a866-a239-45f4-b502-40b4caf010e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c026c3-cf69-433a-a274-9ca6cfcae24c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:48 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0da46ee-8fd1-4269-998a-dbcc82836f79]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG os_brick.utils [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Updating existing volume attachment record: 085089f1-78e3-4017-a6e2-3f61530b9433 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG nova.network.neutron [req-630bb778-87e4-43aa-a02d-db9413cc66aa req-5b3b11d6-e850-49b0-883c-d0307f3f5cf7 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updated VIF entry in instance network info cache for port 6cb5862a-fc82-4f80-820f-02082def752d. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG nova.network.neutron [req-630bb778-87e4-43aa-a02d-db9413cc66aa req-5b3b11d6-e850-49b0-883c-d0307f3f5cf7 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating instance_info_cache with network_info: [{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-630bb778-87e4-43aa-a02d-db9413cc66aa req-5b3b11d6-e850-49b0-883c-d0307f3f5cf7 service nova] Releasing lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-938de9c0-c9bc-4be1-bea6-8dee2f8b3cb8 req-6ea842e3-e0b9-4664-aec2-fc9c8add2825 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received event network-changed-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-938de9c0-c9bc-4be1-bea6-8dee2f8b3cb8 req-6ea842e3-e0b9-4664-aec2-fc9c8add2825 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Refreshing instance network info cache due to event network-changed-cc9f1b45-41d8-4d4c-9396-d9ac528d5783. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:40:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-938de9c0-c9bc-4be1-bea6-8dee2f8b3cb8 req-6ea842e3-e0b9-4664-aec2-fc9c8add2825 service nova] Acquiring lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:40:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-938de9c0-c9bc-4be1-bea6-8dee2f8b3cb8 req-6ea842e3-e0b9-4664-aec2-fc9c8add2825 service nova] Acquired lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:40:51 user nova-compute[75260]: DEBUG nova.network.neutron [req-938de9c0-c9bc-4be1-bea6-8dee2f8b3cb8 req-6ea842e3-e0b9-4664-aec2-fc9c8add2825 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Refreshing network info cache for port cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:40:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:51 user nova-compute[75260]: DEBUG nova.network.neutron [req-938de9c0-c9bc-4be1-bea6-8dee2f8b3cb8 req-6ea842e3-e0b9-4664-aec2-fc9c8add2825 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Updated VIF entry in instance network info cache for port cc9f1b45-41d8-4d4c-9396-d9ac528d5783. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:40:51 user nova-compute[75260]: DEBUG nova.network.neutron [req-938de9c0-c9bc-4be1-bea6-8dee2f8b3cb8 req-6ea842e3-e0b9-4664-aec2-fc9c8add2825 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Updating instance_info_cache with network_info: [{"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:40:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-938de9c0-c9bc-4be1-bea6-8dee2f8b3cb8 req-6ea842e3-e0b9-4664-aec2-fc9c8add2825 service nova] Releasing lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "cd971ad8-53b2-4088-9133-862ab89dc27e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG nova.objects.instance [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lazy-loading 'flavor' on Instance uuid cd971ad8-53b2-4088-9133-862ab89dc27e {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "cd971ad8-53b2-4088-9133-862ab89dc27e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:54 user nova-compute[75260]: INFO nova.compute.manager [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Attaching volume d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e to /dev/vdb
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.utils [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[be478458-ed43-40b1-a18d-b420c01f42db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[07710b4b-fe15-40b2-80f2-c9af29cd1247]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[58808926-ef9f-4734-a21a-b3bbc92dd70f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c6a8e2-b8fc-4b69-9cd9-6ae6a4a41ccc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:40:54 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[749f8f8b-1f1c-494c-952d-3e381cb85653]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.utils [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Updating existing volume attachment record: b04d27a1-c347-44be-bb0f-1447cb326c8d {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnWiRhvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:54 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:54 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:54 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3f9da9-2f09-44e4-8a8d-f7a13326f131]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:40:54 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[494b96f2-1e96-4062-9096-4df9b6333f37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa] added
Nov 27 04:40:54 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d1a9fc-b436-4676-8ad4-c9acb4138c5c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5615e296-726d-474e-b18d-df9255af34c8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gnWiRhvk {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gnWiRhvk" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[01544fc9-56d5-4bfb-98f2-2f50c7909d07]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gnWiRhvk'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[958902e8-e17e-4247-b5fc-acbf45365117]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bccc51-e334-4cfa-ba60-5cc9c97e8805]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:40:54 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:54 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:40:54 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f7798e-86c2-4e3e-8d45-711ebf773cc0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260]
Nov 27 04:40:55 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260] successful.
Nov 27 04:40:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[034d00e5-de9d-4353-8435-027195635f7a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[33763cb4-1c4c-486c-82ed-a7d22e9b986c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:40:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:40:55 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:40:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e60f4b-7022-4027-b783-02d425446753]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnWiRhvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qxdNwmQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:40:55 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23461623262663137', 'path': '/dev/sdi'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461623262663137', 'path': '/dev/sdi'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.438s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:56 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:40:56 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG nova.objects.instance [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a741d90a-b04c-4482-994d-744a742b8fd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:40:56 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:40:56 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:40:56 user nova-compute[75260]:   <source dev="/dev/sdi"/>
Nov 27 04:40:56 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:40:56 user nova-compute[75260]:   <serial>01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa</serial>
Nov 27 04:40:56 user nova-compute[75260]: </disk>
Nov 27 04:40:56 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8943aad2-6d26-4156-a288-600de9b0617c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d] added
Nov 27 04:40:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe78142-e156-42cb-9744-9554db3ecdbf]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdf53d8-b5a9-4817-912e-edb5fbbe0318]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qxdNwmQU {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qxdNwmQU" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af732c9-9747-4733-a29c-c7a81c504251]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qxdNwmQU'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b1dba9-8f36-4c35-bce7-5cb6771fd4a9]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6528e147-09b0-4c23-83c8-79f6b0422054]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:40:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:40:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da4d7df-002e-473a-9194-48a884ab9f13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d, portal: 172.16.0.220,3260]
Nov 27 04:40:56 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d, portal: 172.16.0.220,3260] successful.
Nov 27 04:40:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8f3378-de64-4e42-ab56-5552a7250659]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9128c51-3766-4066-8328-c77ee2ebfe6d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:40:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:40:56 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:40:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1a150e-fcfb-4445-b12e-a58fd52b0566]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qxdNwmQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No VIF found with MAC fa:16:3e:7e:e4:1f, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:40:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-820e1313-e113-4640-97d6-23f6f9d11b5d tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.696s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-220ef5b1-ebd1-48a4-8c51-34c63b8dc43a tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-220ef5b1-ebd1-48a4-8c51-34c63b8dc43a tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-220ef5b1-ebd1-48a4-8c51-34c63b8dc43a tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-220ef5b1-ebd1-48a4-8c51-34c63b8dc43a tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75260) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG nova.objects.instance [None req-220ef5b1-ebd1-48a4-8c51-34c63b8dc43a tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] <== connect_volume: return (1819ms) {'type': 'block', 'scsi_wwn': '23666393136306630', 'path': '/dev/sdj'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666393136306630', 'path': '/dev/sdj'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG nova.objects.instance [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'flavor' on Instance uuid d47665e4-157a-46e2-85a3-1c5cde99db1a {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:40:57 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:40:57 user nova-compute[75260]:   <source dev="/dev/sdj"/>
Nov 27 04:40:57 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:40:57 user nova-compute[75260]:   <serial>07546b0b-458c-407a-8ed3-b578c807d68d</serial>
Nov 27 04:40:57 user nova-compute[75260]: </disk>
Nov 27 04:40:57 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-a9f5858e-d1b5-4772-bde6-a193cf30e823 req-98b3b4f2-bc5c-4f07-854b-576e8425a631 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-unplugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a9f5858e-d1b5-4772-bde6-a193cf30e823 req-98b3b4f2-bc5c-4f07-854b-576e8425a631 service nova] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a9f5858e-d1b5-4772-bde6-a193cf30e823 req-98b3b4f2-bc5c-4f07-854b-576e8425a631 service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a9f5858e-d1b5-4772-bde6-a193cf30e823 req-98b3b4f2-bc5c-4f07-854b-576e8425a631 service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-a9f5858e-d1b5-4772-bde6-a193cf30e823 req-98b3b4f2-bc5c-4f07-854b-576e8425a631 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] No waiting events found dispatching network-vif-unplugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:57 user nova-compute[75260]: WARNING nova.compute.manager [req-a9f5858e-d1b5-4772-bde6-a193cf30e823 req-98b3b4f2-bc5c-4f07-854b-576e8425a631 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received unexpected event network-vif-unplugged-e07f49c0-b893-44bf-a195-c351eadfe333 for instance with vm_state active and task_state powering-off.
Nov 27 04:40:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:40:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:40:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No VIF found with MAC fa:16:3e:d1:01:39, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:40:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4a91cd14-1319-49fd-aeee-7904668583f1 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.964s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance destroyed successfully.
Nov 27 04:40:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-220ef5b1-ebd1-48a4-8c51-34c63b8dc43a tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:40:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-220ef5b1-ebd1-48a4-8c51-34c63b8dc43a tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.125s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-a156872f-88d0-4bd7-9fd5-127f1030fc7e req-5a6aee15-3957-4c0a-9d9f-10bc18b34b7f service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:40:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a156872f-88d0-4bd7-9fd5-127f1030fc7e req-5a6aee15-3957-4c0a-9d9f-10bc18b34b7f service nova] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:40:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a156872f-88d0-4bd7-9fd5-127f1030fc7e req-5a6aee15-3957-4c0a-9d9f-10bc18b34b7f service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:40:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a156872f-88d0-4bd7-9fd5-127f1030fc7e req-5a6aee15-3957-4c0a-9d9f-10bc18b34b7f service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:40:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-a156872f-88d0-4bd7-9fd5-127f1030fc7e req-5a6aee15-3957-4c0a-9d9f-10bc18b34b7f service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] No waiting events found dispatching network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:40:59 user nova-compute[75260]: WARNING nova.compute.manager [req-a156872f-88d0-4bd7-9fd5-127f1030fc7e req-5a6aee15-3957-4c0a-9d9f-10bc18b34b7f service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received unexpected event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 for instance with vm_state stopped and task_state None.
Nov 27 04:40:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdsloHkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:01 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:01 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:01 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda23c3e-25d0-45f2-a3b6-28040738afbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "b25602f8-d770-4f4e-afe7-523676170a0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "b25602f8-d770-4f4e-afe7-523676170a0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:41:01 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5b4369-51d4-4220-9d7f-2fb3e2c53953]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e] added
Nov 27 04:41:01 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f4eeb0-0704-4952-b53a-8f67908edee1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2de0c7-16ec-4f2f-acdb-4de8c2777b12]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GdsloHkb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GdsloHkb" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[523306bc-bc9e-4c84-a8a7-2adef797a72d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GdsloHkb'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c934e9e0-d1fa-4c98-aa31-e706c06d2bf2]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:41:01 user nova-compute[75260]: INFO nova.compute.claims [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Claim successful on node user
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ac809f-017c-4004-a319-a4734b033388]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:01 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:01 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c290ee-f383-47d5-b20e-3a7c9a93fcf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e, portal: 172.16.0.220,3260]
Nov 27 04:41:01 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:01 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fc0759-18b2-4831-abdc-f7ba7e040d3c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ede7a7-e4d7-42b0-861f-eb693cd8c766]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:01 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:01 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:01 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ed7ed3-cc44-404a-bd6c-396fcf6915a5]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:41:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdsloHkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:41:02 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:41:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG nova.policy [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1b9f31e8cfe433ba6988d8be95ff00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a01c78567be4d4ca62fd53ad2937ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:41:02 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Creating image(s)
Nov 27 04:41:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "/opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "/opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "/opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.299s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23662653039383134', 'path': '/dev/sdk'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662653039383134', 'path': '/dev/sdk'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.objects.instance [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lazy-loading 'flavor' on Instance uuid cd971ad8-53b2-4088-9133-862ab89dc27e {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-c7ecf1a8-9197-4462-b855-3a7b45a853b5 req-719bc808-1f81-4da4-8d21-e9e2c37028db service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received event network-changed-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-c7ecf1a8-9197-4462-b855-3a7b45a853b5 req-719bc808-1f81-4da4-8d21-e9e2c37028db service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Refreshing instance network info cache due to event network-changed-98fe9246-07fb-4d29-bdb3-46459e0e2303. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c7ecf1a8-9197-4462-b855-3a7b45a853b5 req-719bc808-1f81-4da4-8d21-e9e2c37028db service nova] Acquiring lock "refresh_cache-a5543a82-a320-4119-8d6e-0476226d619b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c7ecf1a8-9197-4462-b855-3a7b45a853b5 req-719bc808-1f81-4da4-8d21-e9e2c37028db service nova] Acquired lock "refresh_cache-a5543a82-a320-4119-8d6e-0476226d619b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.network.neutron [req-c7ecf1a8-9197-4462-b855-3a7b45a853b5 req-719bc808-1f81-4da4-8d21-e9e2c37028db service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Refreshing network info cache for port 98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.184s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Successfully created port: 71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk 1073741824" returned: 0 in 0.052s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:41:03 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:03 user nova-compute[75260]:   <source dev="/dev/sdk"/>
Nov 27 04:41:03 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:41:03 user nova-compute[75260]:   <serial>d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e</serial>
Nov 27 04:41:03 user nova-compute[75260]: </disk>
Nov 27 04:41:03 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.objects.instance [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lazy-loading 'flavor' on Instance uuid a5543a82-a320-4119-8d6e-0476226d619b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Cannot resize image /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Ensure instance console log exists: /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:03 user nova-compute[75260]: INFO nova.compute.manager [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Attaching volume 0c2d4ef6-6b33-48ce-858a-baa262cee969 to /dev/vdb
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] No VIF found with MAC fa:16:3e:df:93:63, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.network.neutron [req-c7ecf1a8-9197-4462-b855-3a7b45a853b5 req-719bc808-1f81-4da4-8d21-e9e2c37028db service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Updated VIF entry in instance network info cache for port 98fe9246-07fb-4d29-bdb3-46459e0e2303. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.network.neutron [req-c7ecf1a8-9197-4462-b855-3a7b45a853b5 req-719bc808-1f81-4da4-8d21-e9e2c37028db service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Updating instance_info_cache with network_info: [{"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c7ecf1a8-9197-4462-b855-3a7b45a853b5 req-719bc808-1f81-4da4-8d21-e9e2c37028db service nova] Releasing lock "refresh_cache-a5543a82-a320-4119-8d6e-0476226d619b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG os_brick.utils [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af5a357-3af6-4756-b65f-ce5938f1105d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[99189022-b869-4614-b7c8-c11ffb2f0068]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7034b5a-e128-4076-a674-51cb8cc1df16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb0a0b3-6401-431d-99f0-92d1b531ef62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:03 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b13923-fe4b-4000-a6f9-28c56878015e]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dcff84-1eb7-4878-8d83-8b758d86325f tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.327s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG os_brick.utils [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Updating existing volume attachment record: f841c9e8-6c09-4ae2-84d1-7de595fd3870 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Successfully updated port: 71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "refresh_cache-b25602f8-d770-4f4e-afe7-523676170a0d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquired lock "refresh_cache-b25602f8-d770-4f4e-afe7-523676170a0d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-3f68e20d-40a3-45cd-a5a2-214343ec5d93 req-21822aba-79aa-42d4-b9a1-50d2dd384bb8 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received event network-changed-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-3f68e20d-40a3-45cd-a5a2-214343ec5d93 req-21822aba-79aa-42d4-b9a1-50d2dd384bb8 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Refreshing instance network info cache due to event network-changed-71c97463-4d75-4cf4-b4bc-13e6dbcae123. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3f68e20d-40a3-45cd-a5a2-214343ec5d93 req-21822aba-79aa-42d4-b9a1-50d2dd384bb8 service nova] Acquiring lock "refresh_cache-b25602f8-d770-4f4e-afe7-523676170a0d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:41:03 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Updating instance_info_cache with network_info: [{"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Releasing lock "refresh_cache-b25602f8-d770-4f4e-afe7-523676170a0d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Instance network_info: |[{"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3f68e20d-40a3-45cd-a5a2-214343ec5d93 req-21822aba-79aa-42d4-b9a1-50d2dd384bb8 service nova] Acquired lock "refresh_cache-b25602f8-d770-4f4e-afe7-523676170a0d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-3f68e20d-40a3-45cd-a5a2-214343ec5d93 req-21822aba-79aa-42d4-b9a1-50d2dd384bb8 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Refreshing network info cache for port 71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Start _get_guest_xml network_info=[{"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:41:04 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:41:04 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1504296527',display_name='tempest-AttachVolumeNegativeTest-server-1504296527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1504296527',id=13,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwzJaoQEPn0REogIc6sbcnZ9MgcblVeASoWq/afggJaoKzF9jRUKqczUBROtQMqaZ39B+gXQ5auVr4gw/MIFdSpGcnIdJCrUUVwne2AXeuWu5FwyUx0VS+wyfU6wGSx4g==',key_name='tempest-keypair-1657087932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-ybz17g1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=b25602f8-d770-4f4e-afe7-523676170a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:07,bridge_name='br-int',has_traffic_filtering=True,id=71c97463-4d75-4cf4-b4bc-13e6dbcae123,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c97463-4d') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.objects.instance [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'pci_devices' on Instance uuid b25602f8-d770-4f4e-afe7-523676170a0d {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:41:04 user nova-compute[75260]:   <uuid>b25602f8-d770-4f4e-afe7-523676170a0d</uuid>
Nov 27 04:41:04 user nova-compute[75260]:   <name>instance-0000000d</name>
Nov 27 04:41:04 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:41:04 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:41:04 user nova-compute[75260]:   <metadata>
Nov 27 04:41:04 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:41:04 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:41:04 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1504296527</nova:name>
Nov 27 04:41:04 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:41:04</nova:creationTime>
Nov 27 04:41:04 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:41:04 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:41:04 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:41:04 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:41:04 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:41:04 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:41:04 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:41:04 user nova-compute[75260]:       <nova:owner>
Nov 27 04:41:04 user nova-compute[75260]:         <nova:user uuid="a1b9f31e8cfe433ba6988d8be95ff00c">tempest-AttachVolumeNegativeTest-1561165574-project-member</nova:user>
Nov 27 04:41:04 user nova-compute[75260]:         <nova:project uuid="1a01c78567be4d4ca62fd53ad2937ff5">tempest-AttachVolumeNegativeTest-1561165574</nova:project>
Nov 27 04:41:04 user nova-compute[75260]:       </nova:owner>
Nov 27 04:41:04 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:41:04 user nova-compute[75260]:       <nova:ports>
Nov 27 04:41:04 user nova-compute[75260]:         <nova:port uuid="71c97463-4d75-4cf4-b4bc-13e6dbcae123">
Nov 27 04:41:04 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 04:41:04 user nova-compute[75260]:         </nova:port>
Nov 27 04:41:04 user nova-compute[75260]:       </nova:ports>
Nov 27 04:41:04 user nova-compute[75260]:     </nova:instance>
Nov 27 04:41:04 user nova-compute[75260]:   </metadata>
Nov 27 04:41:04 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:41:04 user nova-compute[75260]:     <system>
Nov 27 04:41:04 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:41:04 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:41:04 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:41:04 user nova-compute[75260]:       <entry name="serial">b25602f8-d770-4f4e-afe7-523676170a0d</entry>
Nov 27 04:41:04 user nova-compute[75260]:       <entry name="uuid">b25602f8-d770-4f4e-afe7-523676170a0d</entry>
Nov 27 04:41:04 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:41:04 user nova-compute[75260]:     </system>
Nov 27 04:41:04 user nova-compute[75260]:   </sysinfo>
Nov 27 04:41:04 user nova-compute[75260]:   <os>
Nov 27 04:41:04 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:41:04 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:41:04 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:41:04 user nova-compute[75260]:   </os>
Nov 27 04:41:04 user nova-compute[75260]:   <features>
Nov 27 04:41:04 user nova-compute[75260]:     <acpi/>
Nov 27 04:41:04 user nova-compute[75260]:     <apic/>
Nov 27 04:41:04 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:41:04 user nova-compute[75260]:   </features>
Nov 27 04:41:04 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:41:04 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:41:04 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:41:04 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:41:04 user nova-compute[75260]:   </clock>
Nov 27 04:41:04 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:41:04 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:41:04 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:41:04 user nova-compute[75260]:   </cpu>
Nov 27 04:41:04 user nova-compute[75260]:   <devices>
Nov 27 04:41:04 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:41:04 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:41:04 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk"/>
Nov 27 04:41:04 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:41:04 user nova-compute[75260]:     </disk>
Nov 27 04:41:04 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:41:04 user nova-compute[75260]:       <mac address="fa:16:3e:18:aa:07"/>
Nov 27 04:41:04 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:41:04 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:41:04 user nova-compute[75260]:       <target dev="tap71c97463-4d"/>
Nov 27 04:41:04 user nova-compute[75260]:     </interface>
Nov 27 04:41:04 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:41:04 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/console.log" append="off"/>
Nov 27 04:41:04 user nova-compute[75260]:     </serial>
Nov 27 04:41:04 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:41:04 user nova-compute[75260]:     <video>
Nov 27 04:41:04 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:41:04 user nova-compute[75260]:     </video>
Nov 27 04:41:04 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:41:04 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:41:04 user nova-compute[75260]:     </rng>
Nov 27 04:41:04 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:41:04 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:41:04 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:41:04 user nova-compute[75260]:     </memballoon>
Nov 27 04:41:04 user nova-compute[75260]:   </devices>
Nov 27 04:41:04 user nova-compute[75260]: </domain>
Nov 27 04:41:04 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1504296527',display_name='tempest-AttachVolumeNegativeTest-server-1504296527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1504296527',id=13,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwzJaoQEPn0REogIc6sbcnZ9MgcblVeASoWq/afggJaoKzF9jRUKqczUBROtQMqaZ39B+gXQ5auVr4gw/MIFdSpGcnIdJCrUUVwne2AXeuWu5FwyUx0VS+wyfU6wGSx4g==',key_name='tempest-keypair-1657087932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-ybz17g1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=b25602f8-d770-4f4e-afe7-523676170a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:07,bridge_name='br-int',has_traffic_filtering=True,id=71c97463-4d75-4cf4-b4bc-13e6dbcae123,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c97463-4d') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG os_vif [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:07,bridge_name='br-int',has_traffic_filtering=True,id=71c97463-4d75-4cf4-b4bc-13e6dbcae123,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c97463-4d') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fa58871-725a-5173-92ad-6e20da6cc894', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71c97463-4d, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71c97463-4d, col_values=(('qos', UUID('1c372879-34b2-4b6f-912b-786ec8ae7b5d')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71c97463-4d, col_values=(('external_ids', {'iface-id': '71c97463-4d75-4cf4-b4bc-13e6dbcae123', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:aa:07', 'vm-uuid': 'b25602f8-d770-4f4e-afe7-523676170a0d'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:04 user nova-compute[75260]: INFO os_vif [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:07,bridge_name='br-int',has_traffic_filtering=True,id=71c97463-4d75-4cf4-b4bc-13e6dbcae123,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c97463-4d')
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No VIF found with MAC fa:16:3e:18:aa:07, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-3f68e20d-40a3-45cd-a5a2-214343ec5d93 req-21822aba-79aa-42d4-b9a1-50d2dd384bb8 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Updated VIF entry in instance network info cache for port 71c97463-4d75-4cf4-b4bc-13e6dbcae123. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-3f68e20d-40a3-45cd-a5a2-214343ec5d93 req-21822aba-79aa-42d4-b9a1-50d2dd384bb8 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Updating instance_info_cache with network_info: [{"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3f68e20d-40a3-45cd-a5a2-214343ec5d93 req-21822aba-79aa-42d4-b9a1-50d2dd384bb8 service nova] Releasing lock "refresh_cache-b25602f8-d770-4f4e-afe7-523676170a0d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "cd971ad8-53b2-4088-9133-862ab89dc27e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:05 user nova-compute[75260]: INFO nova.compute.manager [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Detaching volume d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e
Nov 27 04:41:05 user nova-compute[75260]: INFO nova.virt.block_device [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Attempting to driver detach volume d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e from mountpoint /dev/vdb
Nov 27 04:41:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Attempting to detach device vdb from instance cd971ad8-53b2-4088-9133-862ab89dc27e from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:41:05 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:05 user nova-compute[75260]:   <source dev="/dev/sdk"/>
Nov 27 04:41:05 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:41:05 user nova-compute[75260]:   <serial>d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e</serial>
Nov 27 04:41:05 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:41:05 user nova-compute[75260]: </disk>
Nov 27 04:41:05 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:41:05 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Successfully detached device vdb from instance cd971ad8-53b2-4088-9133-862ab89dc27e from the persistent domain config.
Nov 27 04:41:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd971ad8-53b2-4088-9133-862ab89dc27e from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:41:05 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:05 user nova-compute[75260]:   <source dev="/dev/sdk"/>
Nov 27 04:41:05 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:41:05 user nova-compute[75260]:   <serial>d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e</serial>
Nov 27 04:41:05 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:41:05 user nova-compute[75260]: </disk>
Nov 27 04:41:05 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG nova.compute.manager [req-c1ee6362-1897-417e-b785-f28273f09854 req-604aa50a-5f84-47eb-a78c-5d8763fd3724 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received event network-vif-plugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c1ee6362-1897-417e-b785-f28273f09854 req-604aa50a-5f84-47eb-a78c-5d8763fd3724 service nova] Acquiring lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c1ee6362-1897-417e-b785-f28273f09854 req-604aa50a-5f84-47eb-a78c-5d8763fd3724 service nova] Lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c1ee6362-1897-417e-b785-f28273f09854 req-604aa50a-5f84-47eb-a78c-5d8763fd3724 service nova] Lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG nova.compute.manager [req-c1ee6362-1897-417e-b785-f28273f09854 req-604aa50a-5f84-47eb-a78c-5d8763fd3724 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] No waiting events found dispatching network-vif-plugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:05 user nova-compute[75260]: WARNING nova.compute.manager [req-c1ee6362-1897-417e-b785-f28273f09854 req-604aa50a-5f84-47eb-a78c-5d8763fd3724 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received unexpected event network-vif-plugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 for instance with vm_state building and task_state spawning.
Nov 27 04:41:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd971ad8-53b2-4088-9133-862ab89dc27e {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:41:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:06 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f5d332e-d0f7-4bc2-9cbc-d4ef02751658 req-06acdf06-c5cb-4254-bb45-fc1198c933d7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received event network-changed-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:06 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f5d332e-d0f7-4bc2-9cbc-d4ef02751658 req-06acdf06-c5cb-4254-bb45-fc1198c933d7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Refreshing instance network info cache due to event network-changed-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:41:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f5d332e-d0f7-4bc2-9cbc-d4ef02751658 req-06acdf06-c5cb-4254-bb45-fc1198c933d7 service nova] Acquiring lock "refresh_cache-6d334344-945d-4718-9fa1-1464f6d0dad6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:41:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f5d332e-d0f7-4bc2-9cbc-d4ef02751658 req-06acdf06-c5cb-4254-bb45-fc1198c933d7 service nova] Acquired lock "refresh_cache-6d334344-945d-4718-9fa1-1464f6d0dad6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:41:06 user nova-compute[75260]: DEBUG nova.network.neutron [req-2f5d332e-d0f7-4bc2-9cbc-d4ef02751658 req-06acdf06-c5cb-4254-bb45-fc1198c933d7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Refreshing network info cache for port d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:41:06 user nova-compute[75260]: DEBUG nova.network.neutron [req-2f5d332e-d0f7-4bc2-9cbc-d4ef02751658 req-06acdf06-c5cb-4254-bb45-fc1198c933d7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Updated VIF entry in instance network info cache for port d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:41:06 user nova-compute[75260]: DEBUG nova.network.neutron [req-2f5d332e-d0f7-4bc2-9cbc-d4ef02751658 req-06acdf06-c5cb-4254-bb45-fc1198c933d7 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Updating instance_info_cache with network_info: [{"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f5d332e-d0f7-4bc2-9cbc-d4ef02751658 req-06acdf06-c5cb-4254-bb45-fc1198c933d7 service nova] Releasing lock "refresh_cache-6d334344-945d-4718-9fa1-1464f6d0dad6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:41:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-9146beee-c52a-4499-888a-dc32f0e05ac5 req-8bde476f-fafa-4d41-8303-4a30ceb8a6f9 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received event network-vif-plugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9146beee-c52a-4499-888a-dc32f0e05ac5 req-8bde476f-fafa-4d41-8303-4a30ceb8a6f9 service nova] Acquiring lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9146beee-c52a-4499-888a-dc32f0e05ac5 req-8bde476f-fafa-4d41-8303-4a30ceb8a6f9 service nova] Lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9146beee-c52a-4499-888a-dc32f0e05ac5 req-8bde476f-fafa-4d41-8303-4a30ceb8a6f9 service nova] Lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-9146beee-c52a-4499-888a-dc32f0e05ac5 req-8bde476f-fafa-4d41-8303-4a30ceb8a6f9 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] No waiting events found dispatching network-vif-plugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:07 user nova-compute[75260]: WARNING nova.compute.manager [req-9146beee-c52a-4499-888a-dc32f0e05ac5 req-8bde476f-fafa-4d41-8303-4a30ceb8a6f9 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received unexpected event network-vif-plugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 for instance with vm_state building and task_state spawning.
Nov 27 04:41:08 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:41:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:41:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Instance spawned successfully.
Nov 27 04:41:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:41:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:41:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:41:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:41:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:41:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:41:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:41:08 user nova-compute[75260]: INFO nova.compute.manager [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 27 04:41:08 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:41:08 user nova-compute[75260]: INFO nova.compute.manager [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Took 6.46 seconds to build instance.
Nov 27 04:41:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9d4f0f1e-69e0-46de-8c58-7e4f3e047089 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "b25602f8-d770-4f4e-afe7-523676170a0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.560s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwEGHRZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:12 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:12 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:12 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c8a4b4-0295-4076-8c87-db06cf390301]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:41:12 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0027ce97-bab9-4da9-9123-edc0ddb8802f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969] added
Nov 27 04:41:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d2425b-0f24-43df-85a4-f2a95e0bfc22]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "6d334344-945d-4718-9fa1-1464f6d0dad6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdefdf44-63a0-45bd-a619-3f4da28f73dd]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwEGHRZx {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG nova.objects.instance [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lazy-loading 'flavor' on Instance uuid 6d334344-945d-4718-9fa1-1464f6d0dad6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwEGHRZx" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d9927b-b74c-42dc-b9d6-ba9835425db4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nwEGHRZx'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c332d9-1e54-4665-9d38-b8690f1455c3]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cddc25-fd5e-4078-8dba-d1c850b05972]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c09eb5d-5468-4a2a-a677-73be5195a4b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260]
Nov 27 04:41:12 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.067s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70af004-a316-4753-a7b5-7379a3ff341e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "6d334344-945d-4718-9fa1-1464f6d0dad6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:12 user nova-compute[75260]: INFO nova.compute.manager [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Attaching volume c327a3f6-5f90-4ea4-ba62-7a5bc2be472d to /dev/sdc
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc93c5e-6fb0-432b-845f-93a790f85070]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:12 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] HCTL ('43', '-', '-', 0) found on session 12 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.utils [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e25bb-0629-46e8-9cf1-bccff6dda11f]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Searching for a device in session 12 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwEGHRZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbd5505-b6ef-4829-a8ec-639dac399ae8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e84fd7a-2fd1-4a7b-b400-7fcbb07055c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a394accc-7da5-4d0e-9dc8-d21344b36aa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5798e419-3d67-4512-b3c1-7af53f56e24d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:12 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:41:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d6e024-d63b-4ac2-ba6e-c178c19c8c90]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG os_brick.utils [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:12 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Updating existing volume attachment record: b83d1c06-cfab-4317-89e5-73047405fd21 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:41:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '23730356434336132', 'path': '/dev/sdl'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730356434336132', 'path': '/dev/sdl'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:41:13 user nova-compute[75260]: DEBUG nova.objects.instance [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lazy-loading 'flavor' on Instance uuid a5543a82-a320-4119-8d6e-0476226d619b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:41:13 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:13 user nova-compute[75260]:   <source dev="/dev/sdl"/>
Nov 27 04:41:13 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:41:13 user nova-compute[75260]:   <serial>0c2d4ef6-6b33-48ce-858a-baa262cee969</serial>
Nov 27 04:41:13 user nova-compute[75260]: </disk>
Nov 27 04:41:13 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:41:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:41:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:41:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] No VIF found with MAC fa:16:3e:a2:3c:e1, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:41:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-313e2443-cc85-454e-861c-262d2cec2838 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.797s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "a5543a82-a320-4119-8d6e-0476226d619b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG os_brick.utils [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d99c599-fefc-4d07-9c81-5151ebb90db6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f0d487-210e-4915-8fc9-8a3046c2e1a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94eecba-bb5d-4431-b957-c091319ae1be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e946041-7c87-4fc8-ae29-bfb4dbb32874]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:41:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:16 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:41:16 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128d163-ba56-4a6c-bd08-b26ccf312619]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:41:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:41:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:41:16 user nova-compute[75260]: DEBUG os_brick.utils [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:16 user nova-compute[75260]: INFO nova.compute.manager [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Swapping volume 0c2d4ef6-6b33-48ce-858a-baa262cee969 for 9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-5a3e8b23-9205-469b-aab4-d791a0a7de2a req-2214eb0c-ea1a-4f25-9cb2-3864dec8c456 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received event network-changed-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-5a3e8b23-9205-469b-aab4-d791a0a7de2a req-2214eb0c-ea1a-4f25-9cb2-3864dec8c456 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Refreshing instance network info cache due to event network-changed-712b0a9c-0b19-4398-a084-c352567909a6. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:41:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5a3e8b23-9205-469b-aab4-d791a0a7de2a req-2214eb0c-ea1a-4f25-9cb2-3864dec8c456 service nova] Acquiring lock "refresh_cache-b6bca9d4-423b-406f-b016-037b8588be5d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:41:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5a3e8b23-9205-469b-aab4-d791a0a7de2a req-2214eb0c-ea1a-4f25-9cb2-3864dec8c456 service nova] Acquired lock "refresh_cache-b6bca9d4-423b-406f-b016-037b8588be5d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:41:19 user nova-compute[75260]: DEBUG nova.network.neutron [req-5a3e8b23-9205-469b-aab4-d791a0a7de2a req-2214eb0c-ea1a-4f25-9cb2-3864dec8c456 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Refreshing network info cache for port 712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG nova.network.neutron [req-5a3e8b23-9205-469b-aab4-d791a0a7de2a req-2214eb0c-ea1a-4f25-9cb2-3864dec8c456 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Updated VIF entry in instance network info cache for port 712b0a9c-0b19-4398-a084-c352567909a6. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG nova.network.neutron [req-5a3e8b23-9205-469b-aab4-d791a0a7de2a req-2214eb0c-ea1a-4f25-9cb2-3864dec8c456 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Updating instance_info_cache with network_info: [{"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5a3e8b23-9205-469b-aab4-d791a0a7de2a req-2214eb0c-ea1a-4f25-9cb2-3864dec8c456 service nova] Releasing lock "refresh_cache-b6bca9d4-423b-406f-b016-037b8588be5d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-25003f61-0501-4dd1-b223-e1ea2ecc401c req-f1c29caf-9316-41a0-8040-f3e602ca91a7 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received event network-changed-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-25003f61-0501-4dd1-b223-e1ea2ecc401c req-f1c29caf-9316-41a0-8040-f3e602ca91a7 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Refreshing instance network info cache due to event network-changed-f89ade50-f29e-444e-a2fe-135804fe0477. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-25003f61-0501-4dd1-b223-e1ea2ecc401c req-f1c29caf-9316-41a0-8040-f3e602ca91a7 service nova] Acquiring lock "refresh_cache-e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-25003f61-0501-4dd1-b223-e1ea2ecc401c req-f1c29caf-9316-41a0-8040-f3e602ca91a7 service nova] Acquired lock "refresh_cache-e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG nova.network.neutron [req-25003f61-0501-4dd1-b223-e1ea2ecc401c req-f1c29caf-9316-41a0-8040-f3e602ca91a7 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Refreshing network info cache for port f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Acquiring lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG nova.objects.instance [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lazy-loading 'flavor' on Instance uuid e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:20 user nova-compute[75260]: INFO nova.compute.manager [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Rebuilding instance
Nov 27 04:41:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:20 user nova-compute[75260]: DEBUG nova.compute.manager [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG nova.network.neutron [req-25003f61-0501-4dd1-b223-e1ea2ecc401c req-f1c29caf-9316-41a0-8040-f3e602ca91a7 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Updated VIF entry in instance network info cache for port f89ade50-f29e-444e-a2fe-135804fe0477. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG nova.network.neutron [req-25003f61-0501-4dd1-b223-e1ea2ecc401c req-f1c29caf-9316-41a0-8040-f3e602ca91a7 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Updating instance_info_cache with network_info: [{"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-25003f61-0501-4dd1-b223-e1ea2ecc401c req-f1c29caf-9316-41a0-8040-f3e602ca91a7 service nova] Releasing lock "refresh_cache-e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Acquiring lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:21 user nova-compute[75260]: INFO nova.compute.manager [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Attaching volume 33febf02-4979-42b6-a763-bf41dc8d6105 to /dev/vdb
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.utils [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7456378-0f47-4276-997d-0b291218b695]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-e8e79423-4eed-4bd2-9392-aa5dd463adf2 req-21b09f76-d7d6-422a-b477-533220d3b2e8 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received event network-vif-unplugged-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e8e79423-4eed-4bd2-9392-aa5dd463adf2 req-21b09f76-d7d6-422a-b477-533220d3b2e8 service nova] Acquiring lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e8e79423-4eed-4bd2-9392-aa5dd463adf2 req-21b09f76-d7d6-422a-b477-533220d3b2e8 service nova] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e8e79423-4eed-4bd2-9392-aa5dd463adf2 req-21b09f76-d7d6-422a-b477-533220d3b2e8 service nova] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-e8e79423-4eed-4bd2-9392-aa5dd463adf2 req-21b09f76-d7d6-422a-b477-533220d3b2e8 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] No waiting events found dispatching network-vif-unplugged-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:21 user nova-compute[75260]: WARNING nova.compute.manager [req-e8e79423-4eed-4bd2-9392-aa5dd463adf2 req-21b09f76-d7d6-422a-b477-533220d3b2e8 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received unexpected event network-vif-unplugged-712b0a9c-0b19-4398-a084-c352567909a6 for instance with vm_state active and task_state rebuilding.
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e8eeb1-18b3-483c-9262-38a2ac3e0346]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[589cdc26-2e10-49f6-8dae-ed9620b4f697]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c872e98-7848-48b6-8019-3ef49d10620f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:21 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[062c72d0-50f6-4e04-8285-b1f8f046cc06]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.utils [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Updating existing volume attachment record: 35af54d8-9c37-4983-a166-5eb178037b9e {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:41:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Instance destroyed successfully.
Nov 27 04:41:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Instance destroyed successfully.
Nov 27 04:41:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-755932414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1665343800',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALMxnrZzjW0NjXi7/0EuPIGfVftjzNb3zI9XvI/SPptD+18gVLb+KUb1OxRxRdLAsWLS+Gvv1ygIykhXU55vQi/O/jDUVMbsSLlF/YLQvWdSoHo8MWHv8KbCjNZZSENog==',key_name='tempest-keypair-1238704364',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ad3faefb87e4411cbf63770a10d202bd',ramdisk_id='',reservation_id='r-tdycmbuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1233607664',owner_user_name='tempest-ServerActionsV293TestJSON-1233607664-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0ebe750e82f4191a92790fef39693bd',uuid=b6bca9d4-423b-406f-b016-037b8588be5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Converting VIF {"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=712b0a9c-0b19-4398-a084-c352567909a6,network=Network(9ed5e856-a6ab-4ec6-a7a0-162719214b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712b0a9c-0b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_vif [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=712b0a9c-0b19-4398-a084-c352567909a6,network=Network(9ed5e856-a6ab-4ec6-a7a0-162719214b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712b0a9c-0b') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap712b0a9c-0b, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca81d7e4-b7a3-4b05-a95e-3d6812d44df7) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:21 user nova-compute[75260]: INFO os_vif [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=712b0a9c-0b19-4398-a084-c352567909a6,network=Network(9ed5e856-a6ab-4ec6-a7a0-162719214b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712b0a9c-0b')
Nov 27 04:41:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNqEAVyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:21 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[03916a6e-d11e-4c46-9618-eb88bfe07680]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:21 user nova-compute[75260]: No targets found.
Nov 27 04:41:21 user nova-compute[75260]: iSNS:
Nov 27 04:41:21 user nova-compute[75260]: No targets found.
Nov 27 04:41:21 user nova-compute[75260]: STATIC:
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e
Nov 27 04:41:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:21 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:21 user nova-compute[75260]: No targets found.
Nov 27 04:41:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:21 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:21 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f4c0d6-bf94-4045-a875-19da1933a23b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d26aa0-d294-47c3-b844-da1754f720a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:21 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb77cdfb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ac40c2-9008-49ce-83dd-ea1726d54b4d]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45e0348-827c-4d9f-b14c-4b5dbfbe4eb4]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b46846-1300-4e30-a3ec-1db2dd06094f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c857fc58-a4f1-45e9-a0e3-39c2a55f49cf]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26539613264626637', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1605237d', '/dev/disk/by-id/scsi-1SCST_BIO1605237d-e9a2dbf71b20a586') {{(pid=85819) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1b9840-78de-460d-9b95-a92fbde8cd86]: (4, None) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d7edbf-5b38-4d88-ada9-6c4e08711b24]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[15161427-c722-4c9b-bfa3-99b7fdc44c41]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db, portal: 172.16.0.220,3260]
Nov 27 04:41:22 user nova-compute[75260]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87f51e6-22e2-41d7-b8cc-fe671863bb42]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] <== disconnect_volume: return (388ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:22 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Deleting instance files /opt/stack/data/nova/instances/b6bca9d4-423b-406f-b016-037b8588be5d_del
Nov 27 04:41:22 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Deletion of /opt/stack/data/nova/instances/b6bca9d4-423b-406f-b016-037b8588be5d_del complete
Nov 27 04:41:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75260) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 27 04:41:22 user nova-compute[75260]: INFO nova.virt.libvirt.host [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] UEFI support detected
Nov 27 04:41:23 user nova-compute[75260]: DEBUG nova.compute.manager [req-7cedfa73-5c61-4ec8-923d-262974cab6a2 req-710b0e96-572b-4fe7-9fc1-b978c726cf4a service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received event network-vif-plugged-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7cedfa73-5c61-4ec8-923d-262974cab6a2 req-710b0e96-572b-4fe7-9fc1-b978c726cf4a service nova] Acquiring lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7cedfa73-5c61-4ec8-923d-262974cab6a2 req-710b0e96-572b-4fe7-9fc1-b978c726cf4a service nova] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7cedfa73-5c61-4ec8-923d-262974cab6a2 req-710b0e96-572b-4fe7-9fc1-b978c726cf4a service nova] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:23 user nova-compute[75260]: DEBUG nova.compute.manager [req-7cedfa73-5c61-4ec8-923d-262974cab6a2 req-710b0e96-572b-4fe7-9fc1-b978c726cf4a service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] No waiting events found dispatching network-vif-plugged-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:23 user nova-compute[75260]: WARNING nova.compute.manager [req-7cedfa73-5c61-4ec8-923d-262974cab6a2 req-710b0e96-572b-4fe7-9fc1-b978c726cf4a service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received unexpected event network-vif-plugged-712b0a9c-0b19-4398-a084-c352567909a6 for instance with vm_state active and task_state rebuilding.
Nov 27 04:41:25 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd971ad8-53b2-4088-9133-862ab89dc27e is timed out.
Nov 27 04:41:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Successfully detached device vdb from instance cd971ad8-53b2-4088-9133-862ab89dc27e from the live domain config.
Nov 27 04:41:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdsloHkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:25 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7196cd-1141-40cc-bf81-f58b7c8c97c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:25 user nova-compute[75260]: No targets found.
Nov 27 04:41:25 user nova-compute[75260]: iSNS:
Nov 27 04:41:25 user nova-compute[75260]: No targets found.
Nov 27 04:41:25 user nova-compute[75260]: STATIC:
Nov 27 04:41:25 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95
Nov 27 04:41:25 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:25 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:25 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:25 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:25 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:25 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9
Nov 27 04:41:25 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:25 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:25 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:25 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:25 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:25 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:25 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:25 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:25 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc
Nov 27 04:41:25 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:25 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:25 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad
Nov 27 04:41:25 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:25 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:25 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0
Nov 27 04:41:25 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:25 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:25 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:25 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:25 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:25 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e
Nov 27 04:41:25 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:25 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:25 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:25 user nova-compute[75260]: No targets found.
Nov 27 04:41:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:25 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:25 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6391cd9-7179-4775-a502-c2d75ffabb4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81a0df5-87a8-43b4-8ead-a1c3a8f562da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:26 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:26 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:26 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c383250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e'): ({'sdk'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Removing single pathed devices sdk {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4998f7b0-a4df-4e2a-84ad-78d77440a3b7]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04a7cf8-e6a2-40fc-af28-0d68d36616b6]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Flushing IO for device /dev/sdk {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[084bc504-2e7e-4cd9-b817-f3a2e8f3f9c7]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.044s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[576fcba9-7b09-460b-8d89-c05452411b3c]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] SCSI volumes sdk have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b11527b-5e50-461c-bd3d-c9ba54c10b9c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc047a55-08d8-4f68-9c92-d209c346ee10]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e, portal: 172.16.0.220,3260]
Nov 27 04:41:26 user nova-compute[75260]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:26 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3cc353e-8a74-4c9f-bbe9-c0a4924a2f3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[705e095d-8ea8-45b0-b989-7e3584b02f06]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] <== disconnect_volume: return (372ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwZhEAOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:27 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:27 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:27 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[df136945-34bf-4cef-ba60-7288b1789b18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:41:27 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c90ef2-660d-4d78-af0c-726fdaa12605]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d] added
Nov 27 04:41:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHRduBCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a5543a82-a320-4119-8d6e-0476226d619b', 'attached_at': '', 'detached_at': '', 'volume_id': '9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 'serial': '9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwEGHRZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': 'a5543a82-a320-4119-8d6e-0476226d619b', 'attached_at': '', 'detached_at': '', 'volume_id': '0c2d4ef6-6b33-48ce-858a-baa262cee969', 'serial'} {{(pid=75260) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHRduBCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:27 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5d35dd-fad5-4421-8306-6d6785adc0a5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02d3dee-e2e5-4239-8de5-95758afc13ad]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwZhEAOu {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwZhEAOu" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c8db52-7dc1-47ef-a969-96c39dbc9ed8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IwZhEAOu'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.066s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba63732-3d2c-4374-8370-28611582c691]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9999092a-0302-46a7-84b1-777d4e68667b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance b6bca9d4-423b-406f-b016-037b8588be5d could not be found.
Nov 27 04:41:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNqEAVyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:27 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d907c0-1181-4861-9cf0-a58418504e18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d, portal: 172.16.0.220,3260]
Nov 27 04:41:27 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b3051-f701-457d-a4df-c4194975a64f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41600b2-907b-4536-b835-be7bf8e3e87a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:27 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f994d23-8ccc-4d07-93d6-a20604ef0d56]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:41:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwZhEAOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lazy-loading 'flavor' on Instance uuid cd971ad8-53b2-4088-9133-862ab89dc27e {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e16ce3de-451f-44b2-ae6b-0420902114bf tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.192s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GiVavXWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:28 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23835313664306330', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835313664306330', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.372s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:28 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:28 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG nova.objects.instance [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lazy-loading 'flavor' on Instance uuid 6d334344-945d-4718-9fa1-1464f6d0dad6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfbabfb-1fa6-4adf-b27e-86f64b78b711]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:41:28 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:41:28 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:28 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:41:28 user nova-compute[75260]:   <target dev="sdc" bus="scsi"/>
Nov 27 04:41:28 user nova-compute[75260]:   <serial>c327a3f6-5f90-4ea4-ba62-7a5bc2be472d</serial>
Nov 27 04:41:28 user nova-compute[75260]:   <address type="drive" controller="0" unit="2"/>
Nov 27 04:41:28 user nova-compute[75260]: </disk>
Nov 27 04:41:28 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b989250b-435a-4191-82a5-5352eba8259b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc] added
Nov 27 04:41:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c6c59-4175-4907-9130-7bd133abdda8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6f7c7c-ceae-4439-813a-32c85e22e28a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHRduBCF {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHRduBCF" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a8441-c5b7-4a2f-b585-b569e099d952]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yHRduBCF'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3198e23e-4a1d-4a6b-baa1-a1f044c1f69c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f62ff66-56bd-47c9-b4e5-f4da2d05bba2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:28 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3c2ebe-8513-4f98-a59c-48137cd78729]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc, portal: 172.16.0.220,3260]
Nov 27 04:41:28 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3604be1f-f580-419a-98b4-652ffaa14016]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3229d20-ac02-4115-a7c7-985489d1daff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:29 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:29 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:29 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b30a27-7ffe-498f-b32a-6ef2e44bbcc7]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHRduBCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] No BDM found with device name sda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] No VIF found with MAC fa:16:3e:73:18:61, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-07f36488-e51c-442b-a189-26081a7efc2d tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.692s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "6d334344-945d-4718-9fa1-1464f6d0dad6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:29 user nova-compute[75260]: INFO nova.compute.manager [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Detaching volume c327a3f6-5f90-4ea4-ba62-7a5bc2be472d
Nov 27 04:41:29 user nova-compute[75260]: INFO nova.virt.block_device [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Attempting to driver detach volume c327a3f6-5f90-4ea4-ba62-7a5bc2be472d from mountpoint /dev/sdc
Nov 27 04:41:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Attempting to detach device sdc from instance 6d334344-945d-4718-9fa1-1464f6d0dad6 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:41:29 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:29 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:41:29 user nova-compute[75260]:   <target dev="sdc" bus="scsi"/>
Nov 27 04:41:29 user nova-compute[75260]:   <serial>c327a3f6-5f90-4ea4-ba62-7a5bc2be472d</serial>
Nov 27 04:41:29 user nova-compute[75260]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 27 04:41:29 user nova-compute[75260]: </disk>
Nov 27 04:41:29 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:41:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Successfully detached device sdc from instance 6d334344-945d-4718-9fa1-1464f6d0dad6 from the persistent domain config.
Nov 27 04:41:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 6d334344-945d-4718-9fa1-1464f6d0dad6 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:41:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:41:29 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:29 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:41:29 user nova-compute[75260]:   <target dev="sdc" bus="scsi"/>
Nov 27 04:41:29 user nova-compute[75260]:   <serial>c327a3f6-5f90-4ea4-ba62-7a5bc2be472d</serial>
Nov 27 04:41:29 user nova-compute[75260]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 27 04:41:29 user nova-compute[75260]: </disk>
Nov 27 04:41:29 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] <== connect_volume: return (2733ms) {'type': 'block', 'scsi_wwn': '23731396336343837', 'path': '/dev/sdk'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731396336343837', 'path': '/dev/sdk'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.508s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG nova.objects.instance [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lazy-loading 'flavor' on Instance uuid a5543a82-a320-4119-8d6e-0476226d619b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[498ba7bf-cfe1-42ce-994e-3d249e4b4af6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:30 user nova-compute[75260]: No targets found.
Nov 27 04:41:30 user nova-compute[75260]: iSNS:
Nov 27 04:41:30 user nova-compute[75260]: No targets found.
Nov 27 04:41:30 user nova-compute[75260]: STATIC:
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d
Nov 27 04:41:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:30 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:30 user nova-compute[75260]: No targets found.
Nov 27 04:41:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:30 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:30 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d8a05-6a07-4cad-a571-a5f775dbc458]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[959b0027-48e8-4031-add9-59d52f161f01]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb7417e950>, {}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Disconnecting from: [] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] <== disconnect_volume: return (2596ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.471s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:30 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:30 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5317345-f468-42c3-aaef-07e3ba328a5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:41:30 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2cfe38-b4b1-4e54-a61b-acdda222bfef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105] added
Nov 27 04:41:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf60683f-9583-4abd-ba08-5ca89cde5a99]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c077ef-8b48-49ec-a4f3-887c906f8932]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GiVavXWq {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GiVavXWq" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d7bcd6-3a04-4cf5-ba19-415321cecd75]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GiVavXWq'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b74693-6628-4349-978b-f6915b3e1392]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 6d334344-945d-4718-9fa1-1464f6d0dad6 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16a021b-d970-49ba-a409-0966bd3fd084]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --login" returned: 0 in 0.127s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9412c3c3-d39c-49c7-875c-aacaacdfd2ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105, portal: 172.16.0.220,3260]
Nov 27 04:41:30 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[37265323-92ab-4f73-b325-bc649bed6c81]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa8e2d7-189e-41ba-8dd4-15b0b7a67a68]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:30 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] HCTL ('44', '-', '-', 0) found on session 15 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded26a98-b8b2-47ed-9bcf-5de126c8edfb]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Searching for a device in session 15 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GiVavXWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:41:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 136314880 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] <== connect_volume: return (2887ms) {'type': 'block', 'scsi_wwn': '26564613938653334', 'path': '/dev/sdm'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564613938653334', 'path': '/dev/sdm'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG nova.objects.instance [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lazy-loading 'flavor' on Instance uuid e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] attach device xml: <disk type="block" device="disk">
Nov 27 04:41:31 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:31 user nova-compute[75260]:   <source dev="/dev/sdm"/>
Nov 27 04:41:31 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:41:31 user nova-compute[75260]:   <serial>33febf02-4979-42b6-a763-bf41dc8d6105</serial>
Nov 27 04:41:31 user nova-compute[75260]: </disk>
Nov 27 04:41:31 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG nova.compute.manager [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Preparing to wait for external event volume-reimaged-4e37a540-ead2-434b-a6d3-d61c7190a1db {{(pid=75260) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 275775488 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:41:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:41:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] No VIF found with MAC fa:16:3e:62:72:fb, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:41:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c46594c3-9be0-4cb0-bb72-434c0d672470 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.212s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 411041792 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 545259520 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8ba6f543-d6e9-4267-bca3-f793b51908ca tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] volume_snapshot_create: create_info: {'snapshot_id': 'fa50474d-1815-4dc5-8efa-13781bd698fa', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75260) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 27 04:41:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8ba6f543-d6e9-4267-bca3-f793b51908ca tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] snap xml: <domainsnapshot>
Nov 27 04:41:33 user nova-compute[75260]:   <disks>
Nov 27 04:41:33 user nova-compute[75260]:     <disk name="/dev/sdm" snapshot="external" type="file">
Nov 27 04:41:33 user nova-compute[75260]:       <source file="/dev/new_file"/>
Nov 27 04:41:33 user nova-compute[75260]:     </disk>
Nov 27 04:41:33 user nova-compute[75260]:     <disk name="vda" snapshot="no"/>
Nov 27 04:41:33 user nova-compute[75260]:   </disks>
Nov 27 04:41:33 user nova-compute[75260]: </domainsnapshot>
Nov 27 04:41:33 user nova-compute[75260]:  {{(pid=75260) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 27 04:41:33 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8ba6f543-d6e9-4267-bca3-f793b51908ca tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] Lazy-loading 'system_metadata' on Instance uuid e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:33 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8ba6f543-d6e9-4267-bca3-f793b51908ca tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [None req-8ba6f543-d6e9-4267-bca3-f793b51908ca tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     rv = execute(f, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     six.reraise(c, e, tb)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     raise value
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     rv = meth(*args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [None req-8ba6f543-d6e9-4267-bca3-f793b51908ca tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     self._volume_snapshot_create(context, instance, guest,
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     rv = execute(f, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     six.reraise(c, e, tb)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     raise value
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     rv = meth(*args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] 
Nov 27 04:41:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-53a01c3f-6020-4cd0-9a1b-9c9753e84a58 tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] volume_snapshot_delete: delete_info: {'volume_id': '33febf02-4979-42b6-a763-bf41dc8d6105'} {{(pid=75260) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [None req-53a01c3f-6020-4cd0-9a1b-9c9753e84a58 tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402]     if delete_info['type'] != 'qcow2':
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] KeyError: 'type'
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [None req-8ba6f543-d6e9-4267-bca3-f793b51908ca tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot fa50474d-1815-4dc5-8efa-13781bd698fa could not be found.
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     raise value
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot fa50474d-1815-4dc5-8efa-13781bd698fa could not be found. (HTTP 404) (Request-ID: req-2ade0732-1707-454c-9930-46d0aabe0974)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot fa50474d-1815-4dc5-8efa-13781bd698fa could not be found.
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver [None req-53a01c3f-6020-4cd0-9a1b-9c9753e84a58 tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-879998d8-0736-4094-a0da-3a5224dcfe0b)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver 
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 27 04:41:33 user nova-compute[75260]: ERROR nova.virt.libvirt.driver 
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server [None req-8ba6f543-d6e9-4267-bca3-f793b51908ca tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise value
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server 
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server [None req-53a01c3f-6020-4cd0-9a1b-9c9753e84a58 tempest-VolumesAssistedSnapshotsTest-1199858621 tempest-VolumesAssistedSnapshotsTest-1199858621-project] Exception during message handling: KeyError: 'type'
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 27 04:41:33 user nova-compute[75260]: ERROR oslo_messaging.rpc.server 
Nov 27 04:41:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 674234368 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Acquiring lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:33 user nova-compute[75260]: INFO nova.compute.manager [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Detaching volume 33febf02-4979-42b6-a763-bf41dc8d6105
Nov 27 04:41:33 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:41:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 821035008 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:33 user nova-compute[75260]: INFO nova.virt.block_device [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Attempting to driver detach volume 33febf02-4979-42b6-a763-bf41dc8d6105 from mountpoint /dev/vdb
Nov 27 04:41:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Attempting to detach device vdb from instance e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:41:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] detach device xml: <disk type="block" device="disk">
Nov 27 04:41:33 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:33 user nova-compute[75260]:   <source dev="/dev/sdm"/>
Nov 27 04:41:33 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:41:33 user nova-compute[75260]:   <serial>33febf02-4979-42b6-a763-bf41dc8d6105</serial>
Nov 27 04:41:33 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:41:33 user nova-compute[75260]: </disk>
Nov 27 04:41:33 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:41:33 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Successfully detached device vdb from instance e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 from the persistent domain config.
Nov 27 04:41:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:41:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] detach device xml: <disk type="block" device="disk">
Nov 27 04:41:33 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:33 user nova-compute[75260]:   <source dev="/dev/sdm"/>
Nov 27 04:41:33 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:41:33 user nova-compute[75260]:   <serial>33febf02-4979-42b6-a763-bf41dc8d6105</serial>
Nov 27 04:41:33 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:41:33 user nova-compute[75260]: </disk>
Nov 27 04:41:33 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:41:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 1000341504 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:41:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:41:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwEGHRZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:35 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c167a6d-8c47-449f-a029-0b62d104329a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:35 user nova-compute[75260]: No targets found.
Nov 27 04:41:35 user nova-compute[75260]: iSNS:
Nov 27 04:41:35 user nova-compute[75260]: No targets found.
Nov 27 04:41:35 user nova-compute[75260]: STATIC:
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d
Nov 27 04:41:35 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:35 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:35 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:35 user nova-compute[75260]: No targets found.
Nov 27 04:41:35 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:35 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:35 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ed10e-8934-40cf-bc34-f3863002359f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80288c4-edb9-49ea-b6ec-5b98e9262a60]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:35 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:35 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:35 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c31e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969'): ({'sdl'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Removing single pathed devices sdl {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f8237-e45c-46d2-908c-5339e584ad77]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aba515-d5a3-4bf6-8004-2d5a20444bfd]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Flushing IO for device /dev/sdl {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd1fd1-5a40-494a-9c65-675857c8022f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.043s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b7453a-ac58-4849-943b-b29451244fb9]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] SCSI volumes sdl have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[348f3eef-0530-4eb2-ac40-fa7226e030a3]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75e7501-979b-4f99-a395-bb3bba7c652d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260]
Nov 27 04:41:35 user nova-compute[75260]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:35 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b626dd5-9cab-4c70-b525-565c0c57ec19]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] <== disconnect_volume: return (381ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHRduBCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'a5543a82-a320-4119-8d6e-0476226d619b', 'attached_at': '', 'detached_at': '', 'volume_id': '9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 'serial'} {{(pid=75260) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 27 04:41:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] swap_volume: removing Cinder connection for volume 0c2d4ef6-6b33-48ce-858a-baa262cee969 {{(pid=75260) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] swap_volume: Updating volume 0c2d4ef6-6b33-48ce-858a-baa262cee969 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "yHRduBCF", "auth_password": "2foF7OXUEQHJmZ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc"}, "status": "reserved", "instance": "a5543a82-a320-4119-8d6e-0476226d619b", "attached_at": "", "detached_at": "", "volume_id": "9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc", "serial": "9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 'no_device': None, 'attachment_id': '5176c3f4-91a0-46f2-95a9-d910f59e19a6'} {{(pid=75260) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0255822a-2fdb-4426-a1cb-4f50940a2232 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "a5543a82-a320-4119-8d6e-0476226d619b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.425s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:36 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "a5543a82-a320-4119-8d6e-0476226d619b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG os_brick.utils [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d89ab-b81e-4f1f-a364-a19922fc3afd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e94641-83cc-4c31-a281-1ac4e2bc4ec0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2040e523-88e5-4559-9436-423d20b1e6a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0f916b-b289-4efc-ba6a-9c0102be1b5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:37 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:41:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d87c883-fc1c-4cd3-84c9-ccdbb2f59590]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:41:37 user nova-compute[75260]: DEBUG os_brick.utils [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:37 user nova-compute[75260]: INFO nova.compute.manager [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Swapping volume 9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc for 0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:41:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:41:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG nova.compute.manager [req-655a0533-9306-4140-8161-4a69411645c8 req-1d800e80-e372-4395-b5d8-2498e2f41399 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-changed-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG nova.compute.manager [req-655a0533-9306-4140-8161-4a69411645c8 req-1d800e80-e372-4395-b5d8-2498e2f41399 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing instance network info cache due to event network-changed-084ca2c2-3de5-4914-8a78-c273fed9c7a5. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-655a0533-9306-4140-8161-4a69411645c8 req-1d800e80-e372-4395-b5d8-2498e2f41399 service nova] Acquiring lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-655a0533-9306-4140-8161-4a69411645c8 req-1d800e80-e372-4395-b5d8-2498e2f41399 service nova] Acquired lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:41:40 user nova-compute[75260]: DEBUG nova.network.neutron [req-655a0533-9306-4140-8161-4a69411645c8 req-1d800e80-e372-4395-b5d8-2498e2f41399 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Refreshing network info cache for port 084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:41:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.network.neutron [req-655a0533-9306-4140-8161-4a69411645c8 req-1d800e80-e372-4395-b5d8-2498e2f41399 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updated VIF entry in instance network info cache for port 084ca2c2-3de5-4914-8a78-c273fed9c7a5. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.network.neutron [req-655a0533-9306-4140-8161-4a69411645c8 req-1d800e80-e372-4395-b5d8-2498e2f41399 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [{"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:42 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:41:42 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7069MB free_disk=25.54697036743164GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-655a0533-9306-4140-8161-4a69411645c8 req-1d800e80-e372-4395-b5d8-2498e2f41399 service nova] Releasing lock "refresh_cache-b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 12efb820-12ab-442d-a5fe-80b08f12a729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d47665e4-157a-46e2-85a3-1c5cde99db1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance cd971ad8-53b2-4088-9133-862ab89dc27e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance a5543a82-a320-4119-8d6e-0476226d619b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 6d334344-945d-4718-9fa1-1464f6d0dad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance b6bca9d4-423b-406f-b016-037b8588be5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance b511b968-5c5b-4c17-9d14-cccc3bc7d7e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance b25602f8-d770-4f4e-afe7-523676170a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:41:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-3ec111fe-d7d6-47b0-a986-c16a775ffd6d req-a2e7667f-35f4-464a-b0cf-1f536d62ec27 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-changed-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-3ec111fe-d7d6-47b0-a986-c16a775ffd6d req-a2e7667f-35f4-464a-b0cf-1f536d62ec27 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing instance network info cache due to event network-changed-eeb0783a-b889-41cc-bf3d-7860e57b193d. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3ec111fe-d7d6-47b0-a986-c16a775ffd6d req-a2e7667f-35f4-464a-b0cf-1f536d62ec27 service nova] Acquiring lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3ec111fe-d7d6-47b0-a986-c16a775ffd6d req-a2e7667f-35f4-464a-b0cf-1f536d62ec27 service nova] Acquired lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG nova.network.neutron [req-3ec111fe-d7d6-47b0-a986-c16a775ffd6d req-a2e7667f-35f4-464a-b0cf-1f536d62ec27 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Refreshing network info cache for port eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:43 user nova-compute[75260]: INFO nova.compute.manager [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Terminating instance
Nov 27 04:41:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-f9bdb8e3-afaa-49fa-85de-33014d152baa req-439bffa5-0328-499f-9d20-b56c12656d37 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f9bdb8e3-afaa-49fa-85de-33014d152baa req-439bffa5-0328-499f-9d20-b56c12656d37 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f9bdb8e3-afaa-49fa-85de-33014d152baa req-439bffa5-0328-499f-9d20-b56c12656d37 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f9bdb8e3-afaa-49fa-85de-33014d152baa req-439bffa5-0328-499f-9d20-b56c12656d37 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-f9bdb8e3-afaa-49fa-85de-33014d152baa req-439bffa5-0328-499f-9d20-b56c12656d37 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-unplugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-f9bdb8e3-afaa-49fa-85de-33014d152baa req-439bffa5-0328-499f-9d20-b56c12656d37 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-3ec111fe-d7d6-47b0-a986-c16a775ffd6d req-a2e7667f-35f4-464a-b0cf-1f536d62ec27 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updated VIF entry in instance network info cache for port eeb0783a-b889-41cc-bf3d-7860e57b193d. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-3ec111fe-d7d6-47b0-a986-c16a775ffd6d req-a2e7667f-35f4-464a-b0cf-1f536d62ec27 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [{"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3ec111fe-d7d6-47b0-a986-c16a775ffd6d req-a2e7667f-35f4-464a-b0cf-1f536d62ec27 service nova] Releasing lock "refresh_cache-46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-359a2676-c931-4c56-bc89-c874bb58a0c7 req-d43525b7-4d8d-44e5-81a9-287d651dbea8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-359a2676-c931-4c56-bc89-c874bb58a0c7 req-d43525b7-4d8d-44e5-81a9-287d651dbea8 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-359a2676-c931-4c56-bc89-c874bb58a0c7 req-d43525b7-4d8d-44e5-81a9-287d651dbea8 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-359a2676-c931-4c56-bc89-c874bb58a0c7 req-d43525b7-4d8d-44e5-81a9-287d651dbea8 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-359a2676-c931-4c56-bc89-c874bb58a0c7 req-d43525b7-4d8d-44e5-81a9-287d651dbea8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-unplugged-f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-359a2676-c931-4c56-bc89-c874bb58a0c7 req-d43525b7-4d8d-44e5-81a9-287d651dbea8 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-f2b47078-4add-42be-9d9b-b67f20f530d8 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updating instance_info_cache with network_info: [{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-unplugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:45 user nova-compute[75260]: WARNING nova.compute.manager [req-784e9a74-3d30-4461-bd53-cb0fad45c027 req-63459517-e1c0-432a-a8ac-81895f1520b5 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-be10c8c6-5acf-4d1c-96ea-33a907b1ef3c for instance with vm_state active and task_state deleting.
Nov 27 04:41:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Instance destroyed successfully.
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lazy-loading 'resources' on Instance uuid b511b968-5c5b-4c17-9d14-cccc3bc7d7e6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:77:22,bridge_name='br-int',has_traffic_filtering=True,id=084ca2c2-3de5-4914-8a78-c273fed9c7a5,network=Network(ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084ca2c2-3d') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:77:22,bridge_name='br-int',has_traffic_filtering=True,id=084ca2c2-3de5-4914-8a78-c273fed9c7a5,network=Network(ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084ca2c2-3d') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap084ca2c2-3d, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c51d1dc-dc5e-4b40-8ff3-40e3bcbb0b50) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: INFO os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:77:22,bridge_name='br-int',has_traffic_filtering=True,id=084ca2c2-3de5-4914-8a78-c273fed9c7a5,network=Network(ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084ca2c2-3d')
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=be10c8c6-5acf-4d1c-96ea-33a907b1ef3c,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe10c8c6-5a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=be10c8c6-5acf-4d1c-96ea-33a907b1ef3c,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe10c8c6-5a') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe10c8c6-5a, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5960bb2f-8ef0-4b3e-a236-efbb49febf99) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: INFO os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=be10c8c6-5acf-4d1c-96ea-33a907b1ef3c,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe10c8c6-5a')
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:ac,bridge_name='br-int',has_traffic_filtering=True,id=7b99af86-ba33-40ca-9a5a-04b97613e9e7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b99af86-ba') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:ac,bridge_name='br-int',has_traffic_filtering=True,id=7b99af86-ba33-40ca-9a5a-04b97613e9e7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b99af86-ba') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b99af86-ba, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20448ba3-0e8b-4a40-936a-a15fdb836d53) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: INFO os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:ac,bridge_name='br-int',has_traffic_filtering=True,id=7b99af86-ba33-40ca-9a5a-04b97613e9e7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b99af86-ba')
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d0:bc,bridge_name='br-int',has_traffic_filtering=True,id=fc89f3be-50cd-435f-a9df-3987fb4404f8,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc89f3be-50') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d0:bc,bridge_name='br-int',has_traffic_filtering=True,id=fc89f3be-50cd-435f-a9df-3987fb4404f8,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc89f3be-50') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc89f3be-50, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3e16103-848d-4eb7-ad0d-fd05d779a7fa) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: INFO os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d0:bc,bridge_name='br-int',has_traffic_filtering=True,id=fc89f3be-50cd-435f-a9df-3987fb4404f8,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc89f3be-50')
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0d:74,bridge_name='br-int',has_traffic_filtering=True,id=ee28ffb6-999b-4675-85c6-2226b726bba7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee28ffb6-99') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0d:74,bridge_name='br-int',has_traffic_filtering=True,id=ee28ffb6-999b-4675-85c6-2226b726bba7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee28ffb6-99') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee28ffb6-99, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:46 user nova-compute[75260]: WARNING nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-084ca2c2-3de5-4914-8a78-c273fed9c7a5 for instance with vm_state active and task_state deleting.
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-unplugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:46 user nova-compute[75260]: WARNING nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-7b99af86-ba33-40ca-9a5a-04b97613e9e7 for instance with vm_state active and task_state deleting.
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-unplugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:46 user nova-compute[75260]: WARNING nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-fc89f3be-50cd-435f-a9df-3987fb4404f8 for instance with vm_state active and task_state deleting.
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-unplugged-ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-ee28ffb6-999b-4675-85c6-2226b726bba7 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:46 user nova-compute[75260]: WARNING nova.compute.manager [req-5d05c755-4a85-4455-afe3-b84203d29199 req-ecde93a1-e819-48e0-95a1-79a496d31dae service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-ee28ffb6-999b-4675-85c6-2226b726bba7 for instance with vm_state active and task_state deleting.
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b898fbe-b556-4f91-b8ad-a73e86fff88a) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: INFO os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0d:74,bridge_name='br-int',has_traffic_filtering=True,id=ee28ffb6-999b-4675-85c6-2226b726bba7,network=Network(a40bc62e-6fc7-48ff-9d46-172a1d2de7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee28ffb6-99')
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "address": "fa:16:3e:f4:02:d1", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798cf9c6-2c", "ovs_interfaceid": "798cf9c6-2c78-4f74-8a69-2ea7d378fc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:02:d1,bridge_name='br-int',has_traffic_filtering=True,id=798cf9c6-2c78-4f74-8a69-2ea7d378fc43,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf9c6-2c') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:02:d1,bridge_name='br-int',has_traffic_filtering=True,id=798cf9c6-2c78-4f74-8a69-2ea7d378fc43,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf9c6-2c') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap798cf9c6-2c, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d664ac4-6b2c-4ed1-ad9e-45b316d43cd3) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: INFO os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:02:d1,bridge_name='br-int',has_traffic_filtering=True,id=798cf9c6-2c78-4f74-8a69-2ea7d378fc43,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798cf9c6-2c')
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2103664123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2103664123',id=11,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+erRnabcwJxYtr31erakglSx8ozbXusgDwOYRIdzIWBj5bo7peyOg0JEzCNkzwn+3CTp57KAKzTvdb0W/ecb0yyG2XGyc5pIxaQ/yGzkDPCGagChyex62fJAoRibtEw==',key_name='tempest-keypair-685702372',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b3d80de26114ff5964f85313abd9bb9',ramdisk_id='',reservation_id='r-10x0t25x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1968195477',owner_user_name='tempest-TaggedBootDevicesTest_v242-1968195477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f159a82e22314218b9800585ddf19a15',uuid=b511b968-5c5b-4c17-9d14-cccc3bc7d7e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converting VIF {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:57,bridge_name='br-int',has_traffic_filtering=True,id=f2b47078-4add-42be-9d9b-b67f20f530d8,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b47078-4a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:57,bridge_name='br-int',has_traffic_filtering=True,id=f2b47078-4add-42be-9d9b-b67f20f530d8,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b47078-4a') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2b47078-4a, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32780ac4-e988-4380-91e9-a9d144a4219a) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: INFO os_vif [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:57,bridge_name='br-int',has_traffic_filtering=True,id=f2b47078-4add-42be-9d9b-b67f20f530d8,network=Network(aa0d66d1-2d72-445e-9f55-6ae5db6657de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b47078-4a')
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geDLyBdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:46 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd7ed1c-2d7c-4091-b088-4441c41f2ca5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:46 user nova-compute[75260]: No targets found.
Nov 27 04:41:46 user nova-compute[75260]: iSNS:
Nov 27 04:41:46 user nova-compute[75260]: No targets found.
Nov 27 04:41:46 user nova-compute[75260]: STATIC:
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d
Nov 27 04:41:46 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:46 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:46 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:46 user nova-compute[75260]: No targets found.
Nov 27 04:41:46 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:46 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:46 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[87050859-2d13-49a8-bf2a-3af77dbe2a07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[410a9f5e-06f4-479e-aacd-eccaba0a4042]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:46 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:46 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:46 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb74bf9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95'): ({'sde'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Removing single pathed devices sde {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4b40a2-fb50-4120-a3d4-d7df74edb86d]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[48666bcb-41b0-4e74-a484-f64e1f57a881]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Flushing IO for device /dev/sde {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7889ba30-cf11-4c0c-9056-2fb16f0f2ec4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec96d9a-7a40-405a-b0a4-05f7638be560]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwEGHRZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a5543a82-a320-4119-8d6e-0476226d619b', 'attached_at': '', 'detached_at': '', 'volume_id': '0c2d4ef6-6b33-48ce-858a-baa262cee969', 'serial': '0c2d4ef6-6b33-48ce-858a-baa262cee969'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHRduBCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc'}, 'status': 'reserved', 'instance': 'a5543a82-a320-4119-8d6e-0476226d619b', 'attached_at': '', 'detached_at': '', 'volume_id': '9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 'serial'} {{(pid=75260) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwEGHRZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:46 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.116s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ad8818-e93c-465f-9c17-c6dbe0c67678]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1e04dd-5932-4af4-8da4-1f7d8afae82f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95, portal: 172.16.0.220,3260]
Nov 27 04:41:46 user nova-compute[75260]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:46 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-d3401106-7fbe-44a5-acb3-3e4fd235cf3f req-5952eeab-e564-4d9a-8f48-7303fbc0dd48 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d3401106-7fbe-44a5-acb3-3e4fd235cf3f req-5952eeab-e564-4d9a-8f48-7303fbc0dd48 service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d3401106-7fbe-44a5-acb3-3e4fd235cf3f req-5952eeab-e564-4d9a-8f48-7303fbc0dd48 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d3401106-7fbe-44a5-acb3-3e4fd235cf3f req-5952eeab-e564-4d9a-8f48-7303fbc0dd48 service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-d3401106-7fbe-44a5-acb3-3e4fd235cf3f req-5952eeab-e564-4d9a-8f48-7303fbc0dd48 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:46 user nova-compute[75260]: WARNING nova.compute.manager [req-d3401106-7fbe-44a5-acb3-3e4fd235cf3f req-5952eeab-e564-4d9a-8f48-7303fbc0dd48 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-f2b47078-4add-42be-9d9b-b67f20f530d8 for instance with vm_state active and task_state deleting.
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7cc315-86b0-4b49-a74d-9ef83e65dd95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef1cbd-67c8-4ae4-b89b-ad5994fcd34a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.540s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] <== disconnect_volume: return (542ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.257s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:46 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:46 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwabzDyO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:46 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ca22bd-aca5-45aa-9768-b254386bb47b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:41:46 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e5b912-db93-4ef9-898c-01f2d7f8369b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969] added
Nov 27 04:41:46 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e455f492-d20f-45c3-863b-66a1daedadac]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[79221592-7f67-4992-9512-624b375f1cea]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwEGHRZx {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwEGHRZx" returned: 0 in 0.090s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45674b7-d15f-4a04-ac53-f08610290100]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nwEGHRZx'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca74834c-f12a-4e11-ada6-1bc6b994a49a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[087b49ad-6790-40f0-a3a7-6c96b585de30]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:47 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:47 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[be00b774-ea30-4bb7-99df-80ea339f27c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260]
Nov 27 04:41:47 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:47 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[885e9d75-ebf3-4d10-a2a1-192079b0b244]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:47 user nova-compute[75260]: INFO nova.compute.manager [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Terminating instance
Nov 27 04:41:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[340b6b72-de0f-4886-b00f-70fd2d2a69af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:47 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:47 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:47 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[24166271-ac63-4542-af00-5df58849d57a]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: None {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-unplugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-unplugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-plugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] Acquiring lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] No waiting events found dispatching network-vif-plugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:47 user nova-compute[75260]: WARNING nova.compute.manager [req-ffe0c3f8-463b-4122-8d9b-00c5b2a8717f req-a36df350-e640-49c6-9b99-eedea63e6dac service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received unexpected event network-vif-plugged-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 for instance with vm_state active and task_state deleting.
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-453e441b-c87b-48c3-bd0c-0a6bd0091529 req-dc393313-c3f2-4fba-ac49-4967c00b8f58 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-453e441b-c87b-48c3-bd0c-0a6bd0091529 req-dc393313-c3f2-4fba-ac49-4967c00b8f58 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-453e441b-c87b-48c3-bd0c-0a6bd0091529 req-dc393313-c3f2-4fba-ac49-4967c00b8f58 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-453e441b-c87b-48c3-bd0c-0a6bd0091529 req-dc393313-c3f2-4fba-ac49-4967c00b8f58 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-453e441b-c87b-48c3-bd0c-0a6bd0091529 req-dc393313-c3f2-4fba-ac49-4967c00b8f58 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-unplugged-06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-453e441b-c87b-48c3-bd0c-0a6bd0091529 req-dc393313-c3f2-4fba-ac49-4967c00b8f58 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-06fc3d26-c623-4672-8580-0403fad18d83 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwEGHRZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] <== connect_volume: return (1751ms) {'type': 'block', 'scsi_wwn': '23730356434336132', 'path': '/dev/sde'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730356434336132', 'path': '/dev/sde'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.487s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.objects.instance [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lazy-loading 'flavor' on Instance uuid a5543a82-a320-4119-8d6e-0476226d619b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[276ba305-917b-4de2-a78b-f33b2dee4ba9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:48 user nova-compute[75260]: No targets found.
Nov 27 04:41:48 user nova-compute[75260]: iSNS:
Nov 27 04:41:48 user nova-compute[75260]: No targets found.
Nov 27 04:41:48 user nova-compute[75260]: STATIC:
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:48 user nova-compute[75260]: No targets found.
Nov 27 04:41:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:48 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:48 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea94448-6a80-4480-8dd3-9808e9fd7353]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc5b995-1980-48d3-9c8c-e3ee143b61cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54397b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[36edc23c-f319-4e41-a247-35325592fdef]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb649c-5e28-4a06-93bb-b094d1dae23d]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a0657c-2e9e-4146-813c-0ccbfa9084f1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.071s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4f3c26-dc3e-452a-a198-e85a8fe4225c]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOacbd7e13-eccc4c207339e372', '/dev/disk/by-id/scsi-26563636334633230', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_acbd7e13') {{(pid=85819) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47b0ad3-2868-4f70-ada6-c0fa3491e1fa]: (4, None) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84265b5-70d6-49b0-9d0f-15c5166954c7]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.147s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b48e97-b041-450e-abd7-164be01b471e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad, portal: 172.16.0.220,3260]
Nov 27 04:41:48 user nova-compute[75260]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441b8be9-0fbd-4c6e-90ca-a5717762e4ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e92c5ee-7088-4abf-b0d5-2af7223f1bef]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.540s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] <== disconnect_volume: return (2027ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-unplugged-a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-a62d1e1d-4a02-44b5-802f-114dc6320858 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-a62d1e1d-4a02-44b5-802f-114dc6320858 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:48 user nova-compute[75260]: WARNING nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-a62d1e1d-4a02-44b5-802f-114dc6320858 for instance with vm_state active and task_state deleting.
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-unplugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:48 user nova-compute[75260]: WARNING nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-0ad3d43a-6008-4f21-a1a2-6aec72523960 for instance with vm_state active and task_state deleting.
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-unplugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:48 user nova-compute[75260]: WARNING nova.compute.manager [req-d6224474-9ec6-4897-af87-3ffbc7f06803 req-58693ef9-1880-40c3-958a-69c6af51f1cd service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-6bf9d769-b7d2-48dc-9254-f10f32c7f632 for instance with vm_state active and task_state deleting.
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQPcGbUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:48 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a556c-4c98-4d36-903f-e0413563bbd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:48 user nova-compute[75260]: No targets found.
Nov 27 04:41:48 user nova-compute[75260]: iSNS:
Nov 27 04:41:48 user nova-compute[75260]: No targets found.
Nov 27 04:41:48 user nova-compute[75260]: STATIC:
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d
Nov 27 04:41:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:48 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:48 user nova-compute[75260]: No targets found.
Nov 27 04:41:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:48 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:48 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b8d92b-4a6d-4b12-bd19-dc384c7e97ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97e04fa-58fb-4ea4-b25f-7d5c1339d1f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:48 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54463b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Instance destroyed successfully.
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.objects.instance [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lazy-loading 'resources' on Instance uuid 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[93142d82-22f8-48d5-a0a0-3810c7c34805]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:bc:b4,bridge_name='br-int',has_traffic_filtering=True,id=eeb0783a-b889-41cc-bf3d-7860e57b193d,network=Network(35c8ce4f-455b-44f5-9b0f-8e592696b3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0783a-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:bc:b4,bridge_name='br-int',has_traffic_filtering=True,id=eeb0783a-b889-41cc-bf3d-7860e57b193d,network=Network(35c8ce4f-455b-44f5-9b0f-8e592696b3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0783a-b8') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeb0783a-b8, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.034s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aead882-18dc-4cfb-93e3-8f58fd65fd45]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fdc595-086b-427a-9ecc-99e5846d09d1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd657673-ed36-46d1-9627-da2ec9eef25b) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d3b45-ad4e-41c5-9594-5db416002af7]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23035623565643139', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c21f1f9b', '/dev/disk/by-id/scsi-1SCST_BIOc21f1f9b-05b5ed19e403bfe4') {{(pid=85819) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffad143-409f-47f7-b9ac-6fe6cac1dc66]: (4, None) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[91afc330-b379-4613-89d1-c34db781f590]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: INFO os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:bc:b4,bridge_name='br-int',has_traffic_filtering=True,id=eeb0783a-b889-41cc-bf3d-7860e57b193d,network=Network(35c8ce4f-455b-44f5-9b0f-8e592696b3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb0783a-b8')
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:b3,bridge_name='br-int',has_traffic_filtering=True,id=2de06c44-2283-4cdb-bf1f-962fdd3053a1,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de06c44-22') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:b3,bridge_name='br-int',has_traffic_filtering=True,id=2de06c44-2283-4cdb-bf1f-962fdd3053a1,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de06c44-22') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2de06c44-22, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e8dfae-059d-4fff-a159-d6f6d7d908a2]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc, portal: 172.16.0.220,3260]
Nov 27 04:41:49 user nova-compute[75260]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a0bdff1-61d2-4324-81d9-e3ff1e6ed24f) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc65e917-0768-4abf-a881-66d6e93f2afc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.065s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a94825c-c9fa-4a82-90c7-ba7bc7a5e192]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] <== disconnect_volume: return (428ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:49 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Deleting instance files /opt/stack/data/nova/instances/b511b968-5c5b-4c17-9d14-cccc3bc7d7e6_del
Nov 27 04:41:49 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Deletion of /opt/stack/data/nova/instances/b511b968-5c5b-4c17-9d14-cccc3bc7d7e6_del complete
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: INFO nova.compute.manager [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Took 5.96 seconds to destroy the instance on the hypervisor.
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:41:49 user nova-compute[75260]: INFO os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:b3,bridge_name='br-int',has_traffic_filtering=True,id=2de06c44-2283-4cdb-bf1f-962fdd3053a1,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de06c44-22')
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:c8:96,bridge_name='br-int',has_traffic_filtering=True,id=a62d1e1d-4a02-44b5-802f-114dc6320858,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa62d1e1d-4a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:c8:96,bridge_name='br-int',has_traffic_filtering=True,id=a62d1e1d-4a02-44b5-802f-114dc6320858,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa62d1e1d-4a') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa62d1e1d-4a, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60fb316d-d9e4-4a37-9d37-a433ae07edcc) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 110100480 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-unplugged-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-eeb0783a-b889-41cc-bf3d-7860e57b193d for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:49 user nova-compute[75260]: WARNING nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-eeb0783a-b889-41cc-bf3d-7860e57b193d for instance with vm_state active and task_state deleting.
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-unplugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:49 user nova-compute[75260]: WARNING nova.compute.manager [req-0834bc50-35cb-48a5-a0ba-b017826e54a9 req-d3dfe2c4-402a-4a8d-8c8d-ce023ef442a4 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-2de06c44-2283-4cdb-bf1f-962fdd3053a1 for instance with vm_state active and task_state deleting.
Nov 27 04:41:49 user nova-compute[75260]: INFO os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:c8:96,bridge_name='br-int',has_traffic_filtering=True,id=a62d1e1d-4a02-44b5-802f-114dc6320858,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa62d1e1d-4a')
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:5c:cd,bridge_name='br-int',has_traffic_filtering=True,id=0ad3d43a-6008-4f21-a1a2-6aec72523960,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad3d43a-60') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:5c:cd,bridge_name='br-int',has_traffic_filtering=True,id=0ad3d43a-6008-4f21-a1a2-6aec72523960,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad3d43a-60') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ad3d43a-60, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7d094e8-e9ba-4af1-94d2-840d1fda543b) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: INFO os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:5c:cd,bridge_name='br-int',has_traffic_filtering=True,id=0ad3d43a-6008-4f21-a1a2-6aec72523960,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad3d43a-60')
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:75,bridge_name='br-int',has_traffic_filtering=True,id=06fc3d26-c623-4672-8580-0403fad18d83,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fc3d26-c6') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:75,bridge_name='br-int',has_traffic_filtering=True,id=06fc3d26-c623-4672-8580-0403fad18d83,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fc3d26-c6') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06fc3d26-c6, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e76c78c0-bf82-4d1e-8833-4760d655d823) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: INFO os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:47:75,bridge_name='br-int',has_traffic_filtering=True,id=06fc3d26-c623-4672-8580-0403fad18d83,network=Network(72e20dfc-2cdc-44f7-ba12-840b913eeb0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06fc3d26-c6')
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:58:f1,bridge_name='br-int',has_traffic_filtering=True,id=6bf9d769-b7d2-48dc-9254-f10f32c7f632,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf9d769-b7') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:58:f1,bridge_name='br-int',has_traffic_filtering=True,id=6bf9d769-b7d2-48dc-9254-f10f32c7f632,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf9d769-b7') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bf9d769-b7, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dca604e8-a9dd-4cf1-b327-821b9a7e5ac5) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: INFO os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:58:f1,bridge_name='br-int',has_traffic_filtering=True,id=6bf9d769-b7d2-48dc-9254-f10f32c7f632,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bf9d769-b7')
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-110546189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-110546189',id=12,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzvtPkN68b5/I+OJMNmHOw0TUxWFaR1AmBzZyTB9FI0dusQovCxWwZFczEY+rY413XWdsKbnrZJFWvb2QEJH0WCeo+k2vrpzQLmKeR5D1SfJhvPklYo++sDiG3AI2K6Jg==',key_name='tempest-keypair-887946815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc40027c0fdd4916b1a43367e9984462',ramdisk_id='',reservation_id='r-9nhxiw0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1225676720',owner_user_name='tempest-TaggedBootDevicesTest-1225676720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43d426d6a5284e34a2cf5246ad52e210',uuid=46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converting VIF {"id": "e3182588-d313-45c7-981c-25ff46efdae8", "address": "fa:16:3e:cd:e9:4c", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3182588-d3", "ovs_interfaceid": "e3182588-d313-45c7-981c-25ff46efdae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:4c,bridge_name='br-int',has_traffic_filtering=True,id=e3182588-d313-45c7-981c-25ff46efdae8,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3182588-d3') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:4c,bridge_name='br-int',has_traffic_filtering=True,id=e3182588-d313-45c7-981c-25ff46efdae8,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3182588-d3') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3182588-d3, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b3eb1e5-fbe3-4307-a0cc-97530ead1c0f) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-aef1ce48-88b3-471e-908b-e2d514351846 req-a7db7f67-3f1d-4e82-8ac1-3128c36372e7 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received event volume-reimaged-4e37a540-ead2-434b-a6d3-d61c7190a1db {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-aef1ce48-88b3-471e-908b-e2d514351846 req-a7db7f67-3f1d-4e82-8ac1-3128c36372e7 service nova] Acquiring lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-aef1ce48-88b3-471e-908b-e2d514351846 req-a7db7f67-3f1d-4e82-8ac1-3128c36372e7 service nova] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-aef1ce48-88b3-471e-908b-e2d514351846 req-a7db7f67-3f1d-4e82-8ac1-3128c36372e7 service nova] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-aef1ce48-88b3-471e-908b-e2d514351846 req-a7db7f67-3f1d-4e82-8ac1-3128c36372e7 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Processing event volume-reimaged-4e37a540-ead2-434b-a6d3-d61c7190a1db {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.compute.manager [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:41:49 user nova-compute[75260]: INFO os_vif [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:4c,bridge_name='br-int',has_traffic_filtering=True,id=e3182588-d313-45c7-981c-25ff46efdae8,network=Network(0db5af91-85b3-4758-9f14-9a9c3b7c1a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3182588-d3')
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZdrevfb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:49 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecf1b65-76d4-4878-aeca-78ad8c7dcce8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:49 user nova-compute[75260]: No targets found.
Nov 27 04:41:49 user nova-compute[75260]: iSNS:
Nov 27 04:41:49 user nova-compute[75260]: No targets found.
Nov 27 04:41:49 user nova-compute[75260]: STATIC:
Nov 27 04:41:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9
Nov 27 04:41:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0
Nov 27 04:41:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105
Nov 27 04:41:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d
Nov 27 04:41:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:49 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:49 user nova-compute[75260]: No targets found.
Nov 27 04:41:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:49 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:49 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee159bc8-cfc6-4326-b6d1-65b238625406]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 250609664 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:49 user nova-compute[75260]: INFO nova.virt.block_device [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Booting with volume 4e37a540-ead2-434b-a6d3-d61c7190a1db at /dev/vda
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4512738c-8743-4632-accc-355195716b12]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:49 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c2b6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0'): ({'sdf'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Removing single pathed devices sdf {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7406265-2385-46de-bcd0-ad58cb1130b6]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd892422-dd5d-4606-81d7-e074453b8456]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Flushing IO for device /dev/sdf {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.utils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[08443690-f89d-471d-88d3-04ff604cfa94]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9838ee-b3a0-4260-9bd1-e5f126245585]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e08eee-8764-4d2c-9777-bcbecdc3ec2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[582711e9-959f-4c65-aa44-15a654b15e2f]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] SCSI volumes sdf have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:50 user nova-compute[75260]: WARNING nova.compute.manager [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-06fc3d26-c623-4672-8580-0403fad18d83 for instance with vm_state active and task_state deleting.
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-unplugged-e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-unplugged-e3182588-d313-45c7-981c-25ff46efdae8 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-plugged-e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] Acquiring lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] No waiting events found dispatching network-vif-plugged-e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:50 user nova-compute[75260]: WARNING nova.compute.manager [req-e0e3fd2e-1a5f-46fb-86a2-4adba6be8fa7 req-cc001563-3a6f-41c0-825b-37098e205f2e service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received unexpected event network-vif-plugged-e3182588-d313-45c7-981c-25ff46efdae8 for instance with vm_state active and task_state deleting.
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8831d623-8c04-4c7b-a3e2-9663d7c1e39d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c59e11-e06e-425d-877b-9d698793db0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.071s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e928c-0e85-4400-bd30-47fdf91b8109]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:41:50 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2e10e4-96d3-478d-81ce-750e54f2b7e7]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.utils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Updating existing volume attachment record: 3c9de097-5c66-4dbd-a6b7-ae3a5242c615 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e78b46-6352-42d7-ab2e-0a294dcccda6]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0, portal: 172.16.0.220,3260]
Nov 27 04:41:50 user nova-compute[75260]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40109f1d-f8a9-406e-aa0a-a7e8d53c97b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[651bce2b-099a-43e0-b18d-759beaac8a40]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] <== disconnect_volume: return (423ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLdJqzcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:50 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[335680ef-dd82-4424-a139-4411e82b9ca5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:50 user nova-compute[75260]: No targets found.
Nov 27 04:41:50 user nova-compute[75260]: iSNS:
Nov 27 04:41:50 user nova-compute[75260]: No targets found.
Nov 27 04:41:50 user nova-compute[75260]: STATIC:
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:50 user nova-compute[75260]: No targets found.
Nov 27 04:41:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:50 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:50 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:50 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 6d334344-945d-4718-9fa1-1464f6d0dad6 is timed out.
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Successfully detached device sdc from instance 6d334344-945d-4718-9fa1-1464f6d0dad6 from the live domain config.
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwZhEAOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:50 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d02115-6f94-4033-95d7-22a3fff554b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[23de1ec1-c7f9-40f0-9643-07665a4c9a7e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c31c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9'): ({'sdg'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Removing single pathed devices sdg {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 307232768 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cf585b-1265-4dbd-bd26-6aa9bb79b6d5]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f72484-1d7a-4844-b4e3-64f3ab88b604]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Flushing IO for device /dev/sdg {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[60516202-4989-4224-bfd2-65caf16fd973]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.056s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1e1f41-249c-45eb-b43d-ec5f732974c1]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] SCSI volumes sdg have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff00b6ac-f676-4352-b797-ff2a6d7dc9e5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5341bb-720c-4dd6-ad7c-eb4330c57805]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9, portal: 172.16.0.220,3260]
Nov 27 04:41:50 user nova-compute[75260]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:409251ea-c7b3-458d-bd21-c589313b2ad9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8637173a-d794-4411-8d05-0006dc991e9c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] <== disconnect_volume: return (431ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.399s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipXfmjvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:50 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c835c21-e998-4ddf-ac3d-bc6254c4853f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:50 user nova-compute[75260]: No targets found.
Nov 27 04:41:50 user nova-compute[75260]: iSNS:
Nov 27 04:41:50 user nova-compute[75260]: No targets found.
Nov 27 04:41:50 user nova-compute[75260]: STATIC:
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d
Nov 27 04:41:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:50 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:50 user nova-compute[75260]: No targets found.
Nov 27 04:41:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:50 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:50 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d58748-1d89-4570-9c72-25a65a3253b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[338a0b69-1295-4462-8b05-822ff730d3ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:50 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c31c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e11668b-97d9-4bee-9ead-b6e92a8ba13d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed40f5d-62c4-4c10-a183-768f5306be47]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a11eac-0d5b-48fe-bf9e-82d8a53991b5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 439353344 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca142399-350c-4d5b-9ca2-0059f7b688a7]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[620cff68-1d9b-4c48-9cdf-b9de3175b732]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b285f1b-bc11-4c21-ac20-01723163b03a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d, portal: 172.16.0.220,3260]
Nov 27 04:41:51 user nova-compute[75260]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c327a3f6-5f90-4ea4-ba62-7a5bc2be472d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e89b82-7f51-4c81-9c3f-07b329864b1f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] <== disconnect_volume: return (845ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.444s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a8f064-5673-4b1c-8876-d3124914ab61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:51 user nova-compute[75260]: No targets found.
Nov 27 04:41:51 user nova-compute[75260]: iSNS:
Nov 27 04:41:51 user nova-compute[75260]: No targets found.
Nov 27 04:41:51 user nova-compute[75260]: STATIC:
Nov 27 04:41:51 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:51 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:51 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:51 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:51 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:51 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:51 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:51 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:51 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:51 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:51 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:51 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:51 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898
Nov 27 04:41:51 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:51 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:51 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105
Nov 27 04:41:51 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:51 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:51 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:51 user nova-compute[75260]: No targets found.
Nov 27 04:41:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:51 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:51 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[903d4fde-a230-4a70-97ec-c833dcf0c736]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cf1d59-8ba6-472a-ba18-86fb27a9efdc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:51 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:51 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:51 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:51 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:51 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:51 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:51 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:51 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:51 user nova-compute[75260]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 (non-flash)
Nov 27 04:41:51 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c1080d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898'): ({'sdh'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Removing single pathed devices sdh {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eababfd8-6dae-49a4-8924-91004ff490c7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9627994-97b7-4779-8e2b-9577db729841]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Flushing IO for device /dev/sdh {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[96176597-6d03-4ce5-a8fc-46e70af6c43f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 595591168 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e2f02-8244-49e7-9a96-6c9b584a1280]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] SCSI volumes sdh have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9cfa6e-ad08-4442-9e7c-b20139fc7e83]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1300343d-5083-4694-81c6-0f621b6b4c0e]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898, portal: 172.16.0.220,3260]
Nov 27 04:41:51 user nova-compute[75260]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5ddc4b-44d9-4674-b31d-b481e7609898 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49382d4-a5cd-41ee-93b8-8fa0dbb3a5de]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.479s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] <== disconnect_volume: return (923ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Deleting instance files /opt/stack/data/nova/instances/46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80_del
Nov 27 04:41:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Deletion of /opt/stack/data/nova/instances/46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80_del complete
Nov 27 04:41:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-27e2ed16-121b-44ad-952a-6eb5e6491b42 req-b2b7f53f-af93-4369-9e7d-ead1ae7aa04a service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-deleted-798cf9c6-2c78-4f74-8a69-2ea7d378fc43 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:51 user nova-compute[75260]: INFO nova.compute.manager [req-27e2ed16-121b-44ad-952a-6eb5e6491b42 req-b2b7f53f-af93-4369-9e7d-ead1ae7aa04a service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Neutron deleted interface 798cf9c6-2c78-4f74-8a69-2ea7d378fc43; detaching it from the instance and deleting it from the info cache
Nov 27 04:41:51 user nova-compute[75260]: DEBUG nova.network.neutron [req-27e2ed16-121b-44ad-952a-6eb5e6491b42 req-b2b7f53f-af93-4369-9e7d-ead1ae7aa04a service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [{"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "address": "fa:16:3e:ec:d0:bc", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc89f3be-50", "ovs_interfaceid": "fc89f3be-50cd-435f-a9df-3987fb4404f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:52 user nova-compute[75260]: INFO nova.compute.manager [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Took 4.87 seconds to destroy the instance on the hypervisor.
Nov 27 04:41:52 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:41:52 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:41:52 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:41:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 595591168 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-27e2ed16-121b-44ad-952a-6eb5e6491b42 req-b2b7f53f-af93-4369-9e7d-ead1ae7aa04a service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Detach interface failed, port_id=798cf9c6-2c78-4f74-8a69-2ea7d378fc43, reason: Instance b511b968-5c5b-4c17-9d14-cccc3bc7d7e6 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:41:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 678428672 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 782237696 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:53 user nova-compute[75260]: DEBUG nova.objects.instance [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lazy-loading 'flavor' on Instance uuid 6d334344-945d-4718-9fa1-1464f6d0dad6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6903f058-a8a5-44ba-9fed-9de2dbdc18d8 tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.641s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 914358272 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-cfb38a29-5a3f-4ddf-990b-52e11cb543aa req-f147293a-e21a-4221-8c96-070f4cfdfb9c service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-deleted-fc89f3be-50cd-435f-a9df-3987fb4404f8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:53 user nova-compute[75260]: INFO nova.compute.manager [req-cfb38a29-5a3f-4ddf-990b-52e11cb543aa req-f147293a-e21a-4221-8c96-070f4cfdfb9c service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Neutron deleted interface fc89f3be-50cd-435f-a9df-3987fb4404f8; detaching it from the instance and deleting it from the info cache
Nov 27 04:41:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-cfb38a29-5a3f-4ddf-990b-52e11cb543aa req-f147293a-e21a-4221-8c96-070f4cfdfb9c service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [{"id": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "address": "fa:16:3e:ae:77:22", "network": {"id": "ac15cca4-7c8a-41c2-8baf-7c0ad9436d5c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-421941829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084ca2c2-3d", "ovs_interfaceid": "084ca2c2-3de5-4914-8a78-c273fed9c7a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-cfb38a29-5a3f-4ddf-990b-52e11cb543aa req-f147293a-e21a-4221-8c96-070f4cfdfb9c service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Detach interface failed, port_id=fc89f3be-50cd-435f-a9df-3987fb4404f8, reason: Instance b511b968-5c5b-4c17-9d14-cccc3bc7d7e6 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-cfb38a29-5a3f-4ddf-990b-52e11cb543aa req-f147293a-e21a-4221-8c96-070f4cfdfb9c service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-deleted-084ca2c2-3de5-4914-8a78-c273fed9c7a5 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:54 user nova-compute[75260]: INFO nova.compute.manager [req-cfb38a29-5a3f-4ddf-990b-52e11cb543aa req-f147293a-e21a-4221-8c96-070f4cfdfb9c service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Neutron deleted interface 084ca2c2-3de5-4914-8a78-c273fed9c7a5; detaching it from the instance and deleting it from the info cache
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.network.neutron [req-cfb38a29-5a3f-4ddf-990b-52e11cb543aa req-f147293a-e21a-4221-8c96-070f4cfdfb9c service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [{"id": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "address": "fa:16:3e:5a:0c:cf", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe10c8c6-5a", "ovs_interfaceid": "be10c8c6-5acf-4d1c-96ea-33a907b1ef3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "address": "fa:16:3e:2f:02:ac", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b99af86-ba", "ovs_interfaceid": "7b99af86-ba33-40ca-9a5a-04b97613e9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee28ffb6-999b-4675-85c6-2226b726bba7", "address": "fa:16:3e:b5:0d:74", "network": {"id": "a40bc62e-6fc7-48ff-9d46-172a1d2de7ca", "bridge": "br-int", "label": "tempest-device-tagging-net1-2014441944", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee28ffb6-99", "ovs_interfaceid": "ee28ffb6-999b-4675-85c6-2226b726bba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b47078-4add-42be-9d9b-b67f20f530d8", "address": "fa:16:3e:30:62:57", "network": {"id": "aa0d66d1-2d72-445e-9f55-6ae5db6657de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1358820974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b3d80de26114ff5964f85313abd9bb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b47078-4a", "ovs_interfaceid": "f2b47078-4add-42be-9d9b-b67f20f530d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 1061158912 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-cfb38a29-5a3f-4ddf-990b-52e11cb543aa req-f147293a-e21a-4221-8c96-070f4cfdfb9c service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Detach interface failed, port_id=084ca2c2-3de5-4914-8a78-c273fed9c7a5, reason: Instance b511b968-5c5b-4c17-9d14-cccc3bc7d7e6 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:54 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 is timed out.
Nov 27 04:41:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Successfully detached device vdb from instance e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 from the live domain config.
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GiVavXWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:54 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Took 5.19 seconds to deallocate network for instance.
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9310ec0b-2537-4f57-be15-5b032ccafb1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "6d334344-945d-4718-9fa1-1464f6d0dad6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:54 user nova-compute[75260]: No targets found.
Nov 27 04:41:54 user nova-compute[75260]: iSNS:
Nov 27 04:41:54 user nova-compute[75260]: No targets found.
Nov 27 04:41:54 user nova-compute[75260]: STATIC:
Nov 27 04:41:54 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:54 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:54 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:54 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:54 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:54 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:54 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:54 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:54 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:54 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:54 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:54 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:54 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105
Nov 27 04:41:54 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:54 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:54 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:54 user nova-compute[75260]: No targets found.
Nov 27 04:41:54 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:54 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:54 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:54 user nova-compute[75260]: INFO nova.compute.manager [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Terminating instance
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f0df30-dcf6-4cad-a9f6-a37b162c4058]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01aa2a0-9de0-4b36-bcc6-5c93b4c5326e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:54 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:54 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:54 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:54 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:54 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:54 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:54 user nova-compute[75260]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 (non-flash)
Nov 27 04:41:54 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:54 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:54 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54243f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105'): ({'sdm'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Removing single pathed devices sdm {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d68c10c-90f7-4ea9-a130-d1d898a267ad]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-7691b9da-01a4-41e9-af45-22e13c08ef03 req-4eccfbc0-fb46-43e1-8756-866e5f927ac9 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-deleted-e3182588-d313-45c7-981c-25ff46efdae8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:54 user nova-compute[75260]: INFO nova.compute.manager [req-7691b9da-01a4-41e9-af45-22e13c08ef03 req-4eccfbc0-fb46-43e1-8756-866e5f927ac9 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Neutron deleted interface e3182588-d313-45c7-981c-25ff46efdae8; detaching it from the instance and deleting it from the info cache
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.network.neutron [req-7691b9da-01a4-41e9-af45-22e13c08ef03 req-4eccfbc0-fb46-43e1-8756-866e5f927ac9 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [{"id": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "address": "fa:16:3e:82:bc:b4", "network": {"id": "35c8ce4f-455b-44f5-9b0f-8e592696b3d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1789697451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb0783a-b8", "ovs_interfaceid": "eeb0783a-b889-41cc-bf3d-7860e57b193d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[82368061-3572-4bf9-a07c-9889a4025f9a]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Flushing IO for device /dev/sdm {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-7691b9da-01a4-41e9-af45-22e13c08ef03 req-4eccfbc0-fb46-43e1-8756-866e5f927ac9 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Detach interface failed, port_id=e3182588-d313-45c7-981c-25ff46efdae8, reason: Instance 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76b14ab-8468-40f7-9d01-9e4ab7683fe3]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHRduBCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:41:54 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.037s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3670372-4d50-44bb-8063-49d6407b7f88]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] SCSI volumes sdm have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51401eb-98ac-4b1e-ab4b-38f857bb565b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48c28bb-3d8a-442e-ac99-7bcad280fa28]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105, portal: 172.16.0.220,3260]
Nov 27 04:41:54 user nova-compute[75260]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:54 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33febf02-4979-42b6-a763-bf41dc8d6105 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[547b29e2-5fb3-426b-99e5-d49bddb15045]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] <== disconnect_volume: return (406ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.159s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.062s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fb2293-c9f7-4d37-9d45-bbf62cba3a3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:41:54 user nova-compute[75260]: No targets found.
Nov 27 04:41:54 user nova-compute[75260]: iSNS:
Nov 27 04:41:54 user nova-compute[75260]: No targets found.
Nov 27 04:41:54 user nova-compute[75260]: STATIC:
Nov 27 04:41:54 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc
Nov 27 04:41:54 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:54 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:54 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:41:54 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:54 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:54 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:41:54 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:54 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:54 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:54 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:41:54 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:41:54 user nova-compute[75260]: FIRMWARE:
Nov 27 04:41:54 user nova-compute[75260]: No targets found.
Nov 27 04:41:54 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:41:54 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:41:54 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:41:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cabbcd-4f26-45b9-8460-22c38d9b2c50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dca00d-d226-4875-b1fb-b46c9025647b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:55 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:55 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:55 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:41:55 user nova-compute[75260]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc (non-flash)
Nov 27 04:41:55 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:41:55 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:41:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb74bfba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc'): ({'sdk'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Removing single pathed devices sdk {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb94693-bd68-4482-8c85-3d0a9ebf448b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa35de59-48b3-40ca-8696-8e02e24d6063]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Flushing IO for device /dev/sdk {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e491886d-c610-41c9-852a-6acd9fedfbbf]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.038s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa9a8a0-faf5-4fe7-bc28-2421050a7eaa]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] SCSI volumes sdk have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f45b167-cf03-4263-ad14-45b6b605cae0]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8b8d37-92d0-491a-bc19-83ac96339417]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc, portal: 172.16.0.220,3260]
Nov 27 04:41:55 user nova-compute[75260]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc, portal: 172.16.0.220,3260] successful.
Nov 27 04:41:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a81b758-ac48-4599-806b-3d3c063e5046]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] <== disconnect_volume: return (551ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Instance destroyed successfully.
Nov 27 04:41:55 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lazy-loading 'resources' on Instance uuid 6d334344-945d-4718-9fa1-1464f6d0dad6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1714191132',display_name='tempest-AttachSCSIVolumeTestJSON-server-1714191132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1714191132',id=8,image_ref='a69a1da0-dd6e-44ad-a31d-918637711477',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCtlEQRS9bwXkDK7hjRppMZyTnAanbiapdRI+0qmxtizYytIeK4Q7NcxhkaCd+uvqyy8cWDQzvntGvOghzARaRnqEF6pSzD59wDR0EMZ5O1uH6ria3eUJ5T2hv4RFd5VQ==',key_name='tempest-keypair-1613158922',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6328ed7eccf41a4b5a3300302db99f5',ramdisk_id='',reservation_id='r-pkdf2dwl',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a69a1da0-dd6e-44ad-a31d-918637711477',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2046705655',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2046705655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='953e70264643472d8f691f3a171764c0',uuid=6d334344-945d-4718-9fa1-1464f6d0dad6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Converting VIF {"id": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "address": "fa:16:3e:73:18:61", "network": {"id": "0f899e3b-4a56-43d6-8c2d-fe9b6b94be95", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1257855754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6328ed7eccf41a4b5a3300302db99f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6f3da5b-76", "ovs_interfaceid": "d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:18:61,bridge_name='br-int',has_traffic_filtering=True,id=d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6,network=Network(0f899e3b-4a56-43d6-8c2d-fe9b6b94be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f3da5b-76') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG os_vif [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:18:61,bridge_name='br-int',has_traffic_filtering=True,id=d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6,network=Network(0f899e3b-4a56-43d6-8c2d-fe9b6b94be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f3da5b-76') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6f3da5b-76, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9566068-2685-4439-93e4-3ac9629f3009) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:41:55 user nova-compute[75260]: INFO os_vif [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:18:61,bridge_name='br-int',has_traffic_filtering=True,id=d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6,network=Network(0f899e3b-4a56-43d6-8c2d-fe9b6b94be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6f3da5b-76')
Nov 27 04:41:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Deleting instance files /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6_del
Nov 27 04:41:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Deletion of /opt/stack/data/nova/instances/6d334344-945d-4718-9fa1-1464f6d0dad6_del complete
Nov 27 04:41:55 user nova-compute[75260]: INFO nova.compute.manager [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 27 04:41:55 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG nova.compute.manager [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwEGHRZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a5543a82-a320-4119-8d6e-0476226d619b', 'attached_at': '', 'detached_at': '', 'volume_id': '0c2d4ef6-6b33-48ce-858a-baa262cee969', 'serial'} {{(pid=75260) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 27 04:41:55 user nova-compute[75260]: DEBUG nova.compute.manager [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] swap_volume: removing Cinder connection for volume 9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc {{(pid=75260) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-deleted-f2b47078-4add-42be-9d9b-b67f20f530d8 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Received event network-vif-deleted-ee28ffb6-999b-4675-85c6-2226b726bba7 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received event network-vif-unplugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] Acquiring lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] No waiting events found dispatching network-vif-unplugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received event network-vif-unplugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received event network-vif-plugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] Acquiring lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] No waiting events found dispatching network-vif-plugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:41:56 user nova-compute[75260]: WARNING nova.compute.manager [req-48cb78b8-ebe4-4980-88da-b3a5cbb16d83 req-d94cfac8-dadb-4d9d-be3d-799b733ee531 service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received unexpected event network-vif-plugged-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 for instance with vm_state active and task_state deleting.
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:56 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Took 1.04 seconds to deallocate network for instance.
Nov 27 04:41:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-deleted-eeb0783a-b889-41cc-bf3d-7860e57b193d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:56 user nova-compute[75260]: INFO nova.compute.manager [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Neutron deleted interface eeb0783a-b889-41cc-bf3d-7860e57b193d; detaching it from the instance and deleting it from the info cache
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [{"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "06fc3d26-c623-4672-8580-0403fad18d83", "address": "fa:16:3e:f7:47:75", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06fc3d26-c6", "ovs_interfaceid": "06fc3d26-c623-4672-8580-0403fad18d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.volume.cinder [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Update attachment failed for attachment 3c9de097-5c66-4dbd-a6b7-ae3a5242c615. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321)
Nov 27 04:41:56 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Took 4.80 seconds to deallocate network for instance.
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Traceback (most recent call last):
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self.driver.rebuild(**kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     raise NotImplementedError()
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] NotImplementedError
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] 
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] During handling of the above exception, another exception occurred:
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] 
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Traceback (most recent call last):
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     driver_block_device.attach_block_devices(
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     _log_and_attach(device)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     bdm.attach(*attach_args, **attach_kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     ret_val = method(obj, context, *args, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self._do_attach(context, instance, volume, volume_api,
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self._volume_attach(context, volume, connector, instance,
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     connection_info = volume_api.attachment_update(
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     res = method(self, ctx, *args, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     with excutils.save_and_reraise_exception():
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self.force_reraise()
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     raise self.value
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     context, '3.44', skip_version_check=True).attachments.update(
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     return method.func(obj, *args, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     resp = self._update('/attachments/%s' % id, body)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     return self._cs_request(url, 'PUT', **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     return self.request(url, method, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     raise exceptions.from_response(resp, body)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] 
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Detach interface failed, port_id=eeb0783a-b889-41cc-bf3d-7860e57b193d, reason: Instance 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-deleted-06fc3d26-c623-4672-8580-0403fad18d83 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:56 user nova-compute[75260]: INFO nova.compute.manager [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Neutron deleted interface 06fc3d26-c623-4672-8580-0403fad18d83; detaching it from the instance and deleting it from the info cache
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [{"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "address": "fa:16:3e:f7:5c:cd", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad3d43a-60", "ovs_interfaceid": "0ad3d43a-6008-4f21-a1a2-6aec72523960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Detach interface failed, port_id=06fc3d26-c623-4672-8580-0403fad18d83, reason: Instance 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-deleted-0ad3d43a-6008-4f21-a1a2-6aec72523960 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:56 user nova-compute[75260]: INFO nova.compute.manager [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Neutron deleted interface 0ad3d43a-6008-4f21-a1a2-6aec72523960; detaching it from the instance and deleting it from the info cache
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [{"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "address": "fa:16:3e:36:58:f1", "network": {"id": "0db5af91-85b3-4758-9f14-9a9c3b7c1a4e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877265504", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bf9d769-b7", "ovs_interfaceid": "6bf9d769-b7d2-48dc-9254-f10f32c7f632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-e88eec26-d34c-4b6d-b3f6-5a03c38a3ec3 req-12bf6d87-76c1-442f-b4bf-40fc078fd6f6 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Detach interface failed, port_id=0ad3d43a-6008-4f21-a1a2-6aec72523960, reason: Instance 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:41:56 user nova-compute[75260]: DEBUG nova.compute.utils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321) {{(pid=75260) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Traceback (most recent call last):
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self.driver.rebuild(**kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     raise NotImplementedError()
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] NotImplementedError
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] 
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] During handling of the above exception, another exception occurred:
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] 
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Traceback (most recent call last):
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     driver_block_device.attach_block_devices(
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     _log_and_attach(device)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     bdm.attach(*attach_args, **attach_kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     ret_val = method(obj, context, *args, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self._do_attach(context, instance, volume, volume_api,
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self._volume_attach(context, volume, connector, instance,
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     connection_info = volume_api.attachment_update(
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     res = method(self, ctx, *args, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     with excutils.save_and_reraise_exception():
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self.force_reraise()
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     raise self.value
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     context, '3.44', skip_version_check=True).attachments.update(
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     return method.func(obj, *args, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     resp = self._update('/attachments/%s' % id, body)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     return self._cs_request(url, 'PUT', **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     return self.request(url, method, **kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     raise exceptions.from_response(resp, body)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] 
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] During handling of the above exception, another exception occurred:
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] 
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Traceback (most recent call last):
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     yield
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self._do_rebuild_instance_with_claim(
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self._do_rebuild_instance(
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     self._rebuild_default_impl(**kwargs)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d]     raise exception.InvalidBDM(str(ex))
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321)
Nov 27 04:41:56 user nova-compute[75260]: ERROR nova.compute.manager [instance: b6bca9d4-423b-406f-b016-037b8588be5d] 
Nov 27 04:41:57 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG nova.objects.instance [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lazy-loading 'flavor' on Instance uuid e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:41:57 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Deleted allocations for instance 6d334344-945d-4718-9fa1-1464f6d0dad6
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-36b29c46-8007-4c0c-9dbd-5bc0bdb47728 tempest-VolumesAssistedSnapshotsTest-1951332944 tempest-VolumesAssistedSnapshotsTest-1951332944-project-admin] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.421s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ba24a1c-d4a3-45c4-9ccd-a5e9cf917dad tempest-AttachSCSIVolumeTestJSON-2046705655 tempest-AttachSCSIVolumeTestJSON-2046705655-project-member] Lock "6d334344-945d-4718-9fa1-1464f6d0dad6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.835s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] [instance: a5543a82-a320-4119-8d6e-0476226d619b] swap_volume: Updating volume 9ebcc9c0-87f4-46a4-a84d-42d9a823dfbc BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "nwEGHRZx", "auth_password": "MPVuxrURifBoGW", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "0c2d4ef6-6b33-48ce-858a-baa262cee969"}, "status": "reserved", "instance": "a5543a82-a320-4119-8d6e-0476226d619b", "attached_at": "", "detached_at": "", "volume_id": "0c2d4ef6-6b33-48ce-858a-baa262cee969", "serial": "0c2d4ef6-6b33-48ce-858a-baa262cee969"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0c2d4ef6-6b33-48ce-858a-baa262cee969', 'no_device': None, 'attachment_id': '3505780d-372a-4258-9905-277baa75adfa'} {{(pid=75260) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-74fc19f6-769f-4c06-88a9-0fcc3dcb94f2 tempest-TestVolumeSwap-1706340693 tempest-TestVolumeSwap-1706340693-project-admin] Lock "a5543a82-a320-4119-8d6e-0476226d619b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.790s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:57 user nova-compute[75260]: INFO nova.compute.manager [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Nov 27 04:41:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.322s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server [None req-aef1ce48-88b3-471e-908b-e2d514351846 tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server NotImplementedError
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server 
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server 
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server 
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server 
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14697cbf-de58-4306-b40e-6a8468e49321)
Nov 27 04:41:57 user nova-compute[75260]: ERROR oslo_messaging.rpc.server 
Nov 27 04:41:57 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:41:57 user nova-compute[75260]: INFO nova.compute.claims [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Claim successful on node user
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-a28acdd0-d79e-47c0-8f57-f3650b27d996 req-1d5eab1e-7acd-4479-a87f-28b293ad48cb service nova] [instance: 6d334344-945d-4718-9fa1-1464f6d0dad6] Received event network-vif-deleted-d6f3da5b-76e2-4c63-a8b1-23bc3cc5dbd6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:41:58 user nova-compute[75260]: INFO nova.compute.manager [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] [instance: b511b968-5c5b-4c17-9d14-cccc3bc7d7e6] Took 3.62 seconds to detach 3 volumes for instance.
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:41:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.policy [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87cf690bdffe48d39b62bf09cca81d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deff7f2657d442a89aa29b3de5e9680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:41:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Creating image(s)
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "/opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "/opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "/opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.207s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-0ee4bae1-2a81-4112-9584-f6f9244a9cc1 req-42a6e45b-05bd-4c8d-905a-fcfc61a88144 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Received event network-vif-deleted-6bf9d769-b7d2-48dc-9254-f10f32c7f632 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:41:58 user nova-compute[75260]: INFO nova.compute.manager [req-0ee4bae1-2a81-4112-9584-f6f9244a9cc1 req-42a6e45b-05bd-4c8d-905a-fcfc61a88144 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Neutron deleted interface 6bf9d769-b7d2-48dc-9254-f10f32c7f632; detaching it from the instance and deleting it from the info cache
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-0ee4bae1-2a81-4112-9584-f6f9244a9cc1 req-42a6e45b-05bd-4c8d-905a-fcfc61a88144 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Updating instance_info_cache with network_info: [{"id": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "address": "fa:16:3e:37:11:b3", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de06c44-22", "ovs_interfaceid": "2de06c44-2283-4cdb-bf1f-962fdd3053a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a62d1e1d-4a02-44b5-802f-114dc6320858", "address": "fa:16:3e:25:c8:96", "network": {"id": "72e20dfc-2cdc-44f7-ba12-840b913eeb0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-719493466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc40027c0fdd4916b1a43367e9984462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d1e1d-4a", "ovs_interfaceid": "a62d1e1d-4a02-44b5-802f-114dc6320858", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk 1073741824" returned: 0 in 0.087s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:58 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Deleted allocations for instance b511b968-5c5b-4c17-9d14-cccc3bc7d7e6
Nov 27 04:41:58 user nova-compute[75260]: INFO nova.compute.manager [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Detaching volume 0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-0ee4bae1-2a81-4112-9584-f6f9244a9cc1 req-42a6e45b-05bd-4c8d-905a-fcfc61a88144 service nova] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Detach interface failed, port_id=6bf9d769-b7d2-48dc-9254-f10f32c7f632, reason: Instance 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:41:58 user nova-compute[75260]: INFO nova.virt.block_device [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Attempting to driver detach volume 0c2d4ef6-6b33-48ce-858a-baa262cee969 from mountpoint /dev/vdb
Nov 27 04:41:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Attempting to detach device vdb from instance a5543a82-a320-4119-8d6e-0476226d619b from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:41:59 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:59 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:41:59 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:41:59 user nova-compute[75260]:   <serial>0c2d4ef6-6b33-48ce-858a-baa262cee969</serial>
Nov 27 04:41:59 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:41:59 user nova-compute[75260]: </disk>
Nov 27 04:41:59 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b2e22634-219c-489e-bb96-f407c4730376 tempest-TaggedBootDevicesTest_v242-1968195477 tempest-TaggedBootDevicesTest_v242-1968195477-project-member] Lock "b511b968-5c5b-4c17-9d14-cccc3bc7d7e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.655s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:59 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Successfully detached device vdb from instance a5543a82-a320-4119-8d6e-0476226d619b from the persistent domain config.
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5543a82-a320-4119-8d6e-0476226d619b from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:41:59 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:41:59 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:41:59 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:41:59 user nova-compute[75260]:   <serial>0c2d4ef6-6b33-48ce-858a-baa262cee969</serial>
Nov 27 04:41:59 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:41:59 user nova-compute[75260]: </disk>
Nov 27 04:41:59 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Successfully created port: d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.207s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Cannot resize image /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Ensure instance console log exists: /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5543a82-a320-4119-8d6e-0476226d619b {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Successfully updated port: d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "refresh_cache-f29b0503-13ae-4efa-99cf-07b30dbfd2f3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquired lock "refresh_cache-f29b0503-13ae-4efa-99cf-07b30dbfd2f3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Updating instance_info_cache with network_info: [{"id": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "address": "fa:16:3e:f0:a7:a6", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd84fa805-1b", "ovs_interfaceid": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Releasing lock "refresh_cache-f29b0503-13ae-4efa-99cf-07b30dbfd2f3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Instance network_info: |[{"id": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "address": "fa:16:3e:f0:a7:a6", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd84fa805-1b", "ovs_interfaceid": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:41:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Start _get_guest_xml network_info=[{"id": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "address": "fa:16:3e:f0:a7:a6", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd84fa805-1b", "ovs_interfaceid": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:41:59 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:41:59 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1525752170',display_name='tempest-VolumesAdminNegativeTest-server-1525752170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1525752170',id=14,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deff7f2657d442a89aa29b3de5e9680c',ramdisk_id='',reservation_id='r-r9w4enid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-494319220',owner_user_name='tempest-VolumesAdminNegativeTest-494319220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:41:58Z,user_data=None,user_id='87cf690bdffe48d39b62bf09cca81d90',uuid=f29b0503-13ae-4efa-99cf-07b30dbfd2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "address": "fa:16:3e:f0:a7:a6", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd84fa805-1b", "ovs_interfaceid": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converting VIF {"id": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "address": "fa:16:3e:f0:a7:a6", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd84fa805-1b", "ovs_interfaceid": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=d84fa805-1b5d-40a7-8db2-782121d7d54e,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd84fa805-1b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.objects.instance [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lazy-loading 'pci_devices' on Instance uuid f29b0503-13ae-4efa-99cf-07b30dbfd2f3 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:00 user nova-compute[75260]: INFO nova.compute.manager [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] [instance: 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80] Took 3.23 seconds to detach 3 volumes for instance.
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:42:00 user nova-compute[75260]:   <uuid>f29b0503-13ae-4efa-99cf-07b30dbfd2f3</uuid>
Nov 27 04:42:00 user nova-compute[75260]:   <name>instance-0000000e</name>
Nov 27 04:42:00 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:42:00 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:42:00 user nova-compute[75260]:   <metadata>
Nov 27 04:42:00 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:42:00 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:42:00 user nova-compute[75260]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1525752170</nova:name>
Nov 27 04:42:00 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:41:59</nova:creationTime>
Nov 27 04:42:00 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:42:00 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:42:00 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:42:00 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:42:00 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:42:00 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:42:00 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:42:00 user nova-compute[75260]:       <nova:owner>
Nov 27 04:42:00 user nova-compute[75260]:         <nova:user uuid="87cf690bdffe48d39b62bf09cca81d90">tempest-VolumesAdminNegativeTest-494319220-project-member</nova:user>
Nov 27 04:42:00 user nova-compute[75260]:         <nova:project uuid="deff7f2657d442a89aa29b3de5e9680c">tempest-VolumesAdminNegativeTest-494319220</nova:project>
Nov 27 04:42:00 user nova-compute[75260]:       </nova:owner>
Nov 27 04:42:00 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:42:00 user nova-compute[75260]:       <nova:ports>
Nov 27 04:42:00 user nova-compute[75260]:         <nova:port uuid="d84fa805-1b5d-40a7-8db2-782121d7d54e">
Nov 27 04:42:00 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 04:42:00 user nova-compute[75260]:         </nova:port>
Nov 27 04:42:00 user nova-compute[75260]:       </nova:ports>
Nov 27 04:42:00 user nova-compute[75260]:     </nova:instance>
Nov 27 04:42:00 user nova-compute[75260]:   </metadata>
Nov 27 04:42:00 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:42:00 user nova-compute[75260]:     <system>
Nov 27 04:42:00 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:42:00 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:42:00 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:42:00 user nova-compute[75260]:       <entry name="serial">f29b0503-13ae-4efa-99cf-07b30dbfd2f3</entry>
Nov 27 04:42:00 user nova-compute[75260]:       <entry name="uuid">f29b0503-13ae-4efa-99cf-07b30dbfd2f3</entry>
Nov 27 04:42:00 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:42:00 user nova-compute[75260]:     </system>
Nov 27 04:42:00 user nova-compute[75260]:   </sysinfo>
Nov 27 04:42:00 user nova-compute[75260]:   <os>
Nov 27 04:42:00 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:42:00 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:42:00 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:42:00 user nova-compute[75260]:   </os>
Nov 27 04:42:00 user nova-compute[75260]:   <features>
Nov 27 04:42:00 user nova-compute[75260]:     <acpi/>
Nov 27 04:42:00 user nova-compute[75260]:     <apic/>
Nov 27 04:42:00 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:42:00 user nova-compute[75260]:   </features>
Nov 27 04:42:00 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:42:00 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:42:00 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:42:00 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:42:00 user nova-compute[75260]:   </clock>
Nov 27 04:42:00 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:42:00 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:42:00 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:42:00 user nova-compute[75260]:   </cpu>
Nov 27 04:42:00 user nova-compute[75260]:   <devices>
Nov 27 04:42:00 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:42:00 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:42:00 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk"/>
Nov 27 04:42:00 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:42:00 user nova-compute[75260]:     </disk>
Nov 27 04:42:00 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:42:00 user nova-compute[75260]:       <mac address="fa:16:3e:f0:a7:a6"/>
Nov 27 04:42:00 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:42:00 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:42:00 user nova-compute[75260]:       <target dev="tapd84fa805-1b"/>
Nov 27 04:42:00 user nova-compute[75260]:     </interface>
Nov 27 04:42:00 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:42:00 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/console.log" append="off"/>
Nov 27 04:42:00 user nova-compute[75260]:     </serial>
Nov 27 04:42:00 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:42:00 user nova-compute[75260]:     <video>
Nov 27 04:42:00 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:42:00 user nova-compute[75260]:     </video>
Nov 27 04:42:00 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:42:00 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:42:00 user nova-compute[75260]:     </rng>
Nov 27 04:42:00 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:42:00 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:42:00 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:42:00 user nova-compute[75260]:     </memballoon>
Nov 27 04:42:00 user nova-compute[75260]:   </devices>
Nov 27 04:42:00 user nova-compute[75260]: </domain>
Nov 27 04:42:00 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1525752170',display_name='tempest-VolumesAdminNegativeTest-server-1525752170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1525752170',id=14,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deff7f2657d442a89aa29b3de5e9680c',ramdisk_id='',reservation_id='r-r9w4enid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-494319220',owner_user_name='tempest-VolumesAdminNegativeTest-494319220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:41:58Z,user_data=None,user_id='87cf690bdffe48d39b62bf09cca81d90',uuid=f29b0503-13ae-4efa-99cf-07b30dbfd2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "address": "fa:16:3e:f0:a7:a6", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd84fa805-1b", "ovs_interfaceid": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converting VIF {"id": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "address": "fa:16:3e:f0:a7:a6", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd84fa805-1b", "ovs_interfaceid": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=d84fa805-1b5d-40a7-8db2-782121d7d54e,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd84fa805-1b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG os_vif [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=d84fa805-1b5d-40a7-8db2-782121d7d54e,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd84fa805-1b') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '712f7c8e-7232-5016-8633-bc2c6f3ac6db', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd84fa805-1b, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd84fa805-1b, col_values=(('qos', UUID('eef73c7d-4da6-44f7-bc48-64bbce6a27d8')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd84fa805-1b, col_values=(('external_ids', {'iface-id': 'd84fa805-1b5d-40a7-8db2-782121d7d54e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:a7:a6', 'vm-uuid': 'f29b0503-13ae-4efa-99cf-07b30dbfd2f3'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:00 user nova-compute[75260]: INFO os_vif [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=d84fa805-1b5d-40a7-8db2-782121d7d54e,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd84fa805-1b')
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] No VIF found with MAC fa:16:3e:f0:a7:a6, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:00 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Deleted allocations for instance 46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80
Nov 27 04:42:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9a2a5d71-8ab0-4c15-b065-0fc96828551e tempest-TaggedBootDevicesTest-1225676720 tempest-TaggedBootDevicesTest-1225676720-project-member] Lock "46bd9bcd-745e-4a2b-9ef0-5f4b8a426a80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.518s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-bfe6d5c5-8dcf-4c29-980a-98c00f457d2f req-b3c3c719-e07d-4245-ba48-05670431e783 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Received event network-changed-d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-bfe6d5c5-8dcf-4c29-980a-98c00f457d2f req-b3c3c719-e07d-4245-ba48-05670431e783 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Refreshing instance network info cache due to event network-changed-d84fa805-1b5d-40a7-8db2-782121d7d54e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bfe6d5c5-8dcf-4c29-980a-98c00f457d2f req-b3c3c719-e07d-4245-ba48-05670431e783 service nova] Acquiring lock "refresh_cache-f29b0503-13ae-4efa-99cf-07b30dbfd2f3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bfe6d5c5-8dcf-4c29-980a-98c00f457d2f req-b3c3c719-e07d-4245-ba48-05670431e783 service nova] Acquired lock "refresh_cache-f29b0503-13ae-4efa-99cf-07b30dbfd2f3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:42:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-bfe6d5c5-8dcf-4c29-980a-98c00f457d2f req-b3c3c719-e07d-4245-ba48-05670431e783 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Refreshing network info cache for port d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG nova.network.neutron [req-bfe6d5c5-8dcf-4c29-980a-98c00f457d2f req-b3c3c719-e07d-4245-ba48-05670431e783 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Updated VIF entry in instance network info cache for port d84fa805-1b5d-40a7-8db2-782121d7d54e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG nova.network.neutron [req-bfe6d5c5-8dcf-4c29-980a-98c00f457d2f req-b3c3c719-e07d-4245-ba48-05670431e783 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Updating instance_info_cache with network_info: [{"id": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "address": "fa:16:3e:f0:a7:a6", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd84fa805-1b", "ovs_interfaceid": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bfe6d5c5-8dcf-4c29-980a-98c00f457d2f req-b3c3c719-e07d-4245-ba48-05670431e783 service nova] Releasing lock "refresh_cache-f29b0503-13ae-4efa-99cf-07b30dbfd2f3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG nova.compute.manager [req-4097bbfb-7e01-43de-8a39-2eea864a18bc req-0f8d6a76-a36e-4b14-9c88-ec41a6160ce4 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Received event network-vif-plugged-d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4097bbfb-7e01-43de-8a39-2eea864a18bc req-0f8d6a76-a36e-4b14-9c88-ec41a6160ce4 service nova] Acquiring lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4097bbfb-7e01-43de-8a39-2eea864a18bc req-0f8d6a76-a36e-4b14-9c88-ec41a6160ce4 service nova] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4097bbfb-7e01-43de-8a39-2eea864a18bc req-0f8d6a76-a36e-4b14-9c88-ec41a6160ce4 service nova] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:01 user nova-compute[75260]: DEBUG nova.compute.manager [req-4097bbfb-7e01-43de-8a39-2eea864a18bc req-0f8d6a76-a36e-4b14-9c88-ec41a6160ce4 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] No waiting events found dispatching network-vif-plugged-d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:01 user nova-compute[75260]: WARNING nova.compute.manager [req-4097bbfb-7e01-43de-8a39-2eea864a18bc req-0f8d6a76-a36e-4b14-9c88-ec41a6160ce4 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Received unexpected event network-vif-plugged-d84fa805-1b5d-40a7-8db2-782121d7d54e for instance with vm_state building and task_state spawning.
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:42:03 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Instance spawned successfully.
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:42:03 user nova-compute[75260]: INFO nova.compute.manager [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-b6f8a07e-5de7-452b-8da8-1a4fc6b3e0e8 req-6dd2004a-673f-42a6-95f9-0c89a224a044 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Received event network-vif-plugged-d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b6f8a07e-5de7-452b-8da8-1a4fc6b3e0e8 req-6dd2004a-673f-42a6-95f9-0c89a224a044 service nova] Acquiring lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b6f8a07e-5de7-452b-8da8-1a4fc6b3e0e8 req-6dd2004a-673f-42a6-95f9-0c89a224a044 service nova] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b6f8a07e-5de7-452b-8da8-1a4fc6b3e0e8 req-6dd2004a-673f-42a6-95f9-0c89a224a044 service nova] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-b6f8a07e-5de7-452b-8da8-1a4fc6b3e0e8 req-6dd2004a-673f-42a6-95f9-0c89a224a044 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] No waiting events found dispatching network-vif-plugged-d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:03 user nova-compute[75260]: WARNING nova.compute.manager [req-b6f8a07e-5de7-452b-8da8-1a4fc6b3e0e8 req-6dd2004a-673f-42a6-95f9-0c89a224a044 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Received unexpected event network-vif-plugged-d84fa805-1b5d-40a7-8db2-782121d7d54e for instance with vm_state building and task_state spawning.
Nov 27 04:42:03 user nova-compute[75260]: INFO nova.compute.manager [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Took 6.57 seconds to build instance.
Nov 27 04:42:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b62b959-1c80-4427-833b-20d735cd0ac2 tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.779s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "b6bca9d4-423b-406f-b016-037b8588be5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "b6bca9d4-423b-406f-b016-037b8588be5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "b6bca9d4-423b-406f-b016-037b8588be5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:11 user nova-compute[75260]: INFO nova.compute.manager [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Terminating instance
Nov 27 04:42:11 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [-] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] During wait destroy, instance disappeared. {{(pid=75260) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 27 04:42:11 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Instance destroyed successfully.
Nov 27 04:42:11 user nova-compute[75260]: DEBUG nova.objects.instance [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lazy-loading 'resources' on Instance uuid b6bca9d4-423b-406f-b016-037b8588be5d {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T04:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-755932414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1665343800',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALMxnrZzjW0NjXi7/0EuPIGfVftjzNb3zI9XvI/SPptD+18gVLb+KUb1OxRxRdLAsWLS+Gvv1ygIykhXU55vQi/O/jDUVMbsSLlF/YLQvWdSoHo8MWHv8KbCjNZZSENog==',key_name='tempest-keypair-1238704364',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad3faefb87e4411cbf63770a10d202bd',ramdisk_id='',reservation_id='r-tdycmbuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1233607664',owner_user_name='tempest-ServerActionsV293TestJSON-1233607664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0ebe750e82f4191a92790fef39693bd',uuid=b6bca9d4-423b-406f-b016-037b8588be5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Converting VIF {"id": "712b0a9c-0b19-4398-a084-c352567909a6", "address": "fa:16:3e:1d:4c:ef", "network": {"id": "9ed5e856-a6ab-4ec6-a7a0-162719214b1d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-833187738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad3faefb87e4411cbf63770a10d202bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712b0a9c-0b", "ovs_interfaceid": "712b0a9c-0b19-4398-a084-c352567909a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=712b0a9c-0b19-4398-a084-c352567909a6,network=Network(9ed5e856-a6ab-4ec6-a7a0-162719214b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712b0a9c-0b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_vif [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=712b0a9c-0b19-4398-a084-c352567909a6,network=Network(9ed5e856-a6ab-4ec6-a7a0-162719214b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712b0a9c-0b') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap712b0a9c-0b, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:42:11 user nova-compute[75260]: INFO os_vif [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=712b0a9c-0b19-4398-a084-c352567909a6,network=Network(9ed5e856-a6ab-4ec6-a7a0-162719214b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712b0a9c-0b')
Nov 27 04:42:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNqEAVyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:42:11 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1aa6aa-cec9-4e8c-8ba8-092b1a3941fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:42:11 user nova-compute[75260]: No targets found.
Nov 27 04:42:11 user nova-compute[75260]: iSNS:
Nov 27 04:42:11 user nova-compute[75260]: No targets found.
Nov 27 04:42:11 user nova-compute[75260]: STATIC:
Nov 27 04:42:11 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:42:11 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:11 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:11 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:42:11 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:11 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:11 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:42:11 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:11 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:11 user nova-compute[75260]: FIRMWARE:
Nov 27 04:42:11 user nova-compute[75260]: No targets found.
Nov 27 04:42:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:42:11 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:42:11 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e37a540-ead2-434b-a6d3-d61c7190a1db', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49593e6-8837-4a4f-946e-a36cf35bfe57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[da13b669-29af-458d-9463-045d74657c2c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:11 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:42:11 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:42:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:11 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:42:11 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:42:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54223e20>, {}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Disconnecting from: [] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] <== disconnect_volume: return (81ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:42:11 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Deletion of /opt/stack/data/nova/instances/b6bca9d4-423b-406f-b016-037b8588be5d_del complete
Nov 27 04:42:11 user nova-compute[75260]: INFO nova.compute.manager [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Took 0.26 seconds to destroy the instance on the hypervisor.
Nov 27 04:42:11 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:42:11 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:42:12 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:12 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Took 0.96 seconds to deallocate network for instance.
Nov 27 04:42:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-ebceb881-3b34-4c98-8591-f98629aa1c84 req-bac32e28-0d79-4a15-937c-5f991668d8b3 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Received event network-vif-deleted-712b0a9c-0b19-4398-a084-c352567909a6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:12 user nova-compute[75260]: INFO nova.compute.manager [req-ebceb881-3b34-4c98-8591-f98629aa1c84 req-bac32e28-0d79-4a15-937c-5f991668d8b3 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Neutron deleted interface 712b0a9c-0b19-4398-a084-c352567909a6; detaching it from the instance and deleting it from the info cache
Nov 27 04:42:12 user nova-compute[75260]: DEBUG nova.network.neutron [req-ebceb881-3b34-4c98-8591-f98629aa1c84 req-bac32e28-0d79-4a15-937c-5f991668d8b3 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-ebceb881-3b34-4c98-8591-f98629aa1c84 req-bac32e28-0d79-4a15-937c-5f991668d8b3 service nova] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Detach interface failed, port_id=712b0a9c-0b19-4398-a084-c352567909a6, reason: Instance b6bca9d4-423b-406f-b016-037b8588be5d could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:42:12 user nova-compute[75260]: INFO nova.compute.manager [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Took 0.07 seconds to detach 1 volumes for instance.
Nov 27 04:42:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] [instance: b6bca9d4-423b-406f-b016-037b8588be5d] Deleting volume: 4e37a540-ead2-434b-a6d3-d61c7190a1db {{(pid=75260) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 04:42:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:13 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:42:13 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:42:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6b799ab7-52af-4f1c-9106-78b5629c983c tempest-ServerActionsV293TestJSON-1233607664 tempest-ServerActionsV293TestJSON-1233607664-project-member] Lock "b6bca9d4-423b-406f-b016-037b8588be5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.837s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 3348-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:42:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:42:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:42:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:19 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a5543a82-a320-4119-8d6e-0476226d619b is timed out.
Nov 27 04:42:19 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Successfully detached device vdb from instance a5543a82-a320-4119-8d6e-0476226d619b from the live domain config.
Nov 27 04:42:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwEGHRZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '0c2d4ef6-6b33-48ce-858a-baa262cee969'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:42:19 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac3ec03-1808-4d63-b577-7780352e800b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:42:19 user nova-compute[75260]: No targets found.
Nov 27 04:42:19 user nova-compute[75260]: iSNS:
Nov 27 04:42:19 user nova-compute[75260]: No targets found.
Nov 27 04:42:19 user nova-compute[75260]: STATIC:
Nov 27 04:42:19 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:42:19 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:19 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:19 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:42:19 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:19 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:19 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969
Nov 27 04:42:19 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:19 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:19 user nova-compute[75260]: FIRMWARE:
Nov 27 04:42:19 user nova-compute[75260]: No targets found.
Nov 27 04:42:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:42:19 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:42:19 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[169233eb-7d78-4358-a2be-facf30a1db27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[898f9756-1d34-403f-b9de-9231c3f08a28]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:19 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:42:19 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:42:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:19 user nova-compute[75260]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 (non-flash)
Nov 27 04:42:19 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:42:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54256710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969'): ({'sde'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Removing single pathed devices sde {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e1ae4-baac-4843-bb34-3020a236c649]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a590a0d-6079-4dd9-b9d1-ad81d210d516]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Flushing IO for device /dev/sde {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ed63a0-ab3c-410b-bc23-54d0d1355b08]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab24daf7-cedc-4862-9cfe-f312a4f6e44f]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a8192-d6f3-485b-b464-044edc515c83]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f553561-e265-4b48-b0ad-e0f69d7bb46f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260]
Nov 27 04:42:19 user nova-compute[75260]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969, portal: 172.16.0.220,3260] successful.
Nov 27 04:42:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2d4ef6-6b33-48ce-858a-baa262cee969 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5561a2af-9118-4dcc-83f2-bf01394e37ad]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] <== disconnect_volume: return (291ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:42:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:42:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:20 user nova-compute[75260]: DEBUG nova.objects.instance [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lazy-loading 'flavor' on Instance uuid a5543a82-a320-4119-8d6e-0476226d619b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7507aab5-f16b-473c-be22-ab52ebd60c5c tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.800s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Acquiring lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Acquiring lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:27 user nova-compute[75260]: INFO nova.compute.manager [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Terminating instance
Nov 27 04:42:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-40ac58da-3112-4d72-bd0f-b4132b1d891d req-75a43f6a-7d10-4399-a2be-653c6662f6da service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received event network-vif-unplugged-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40ac58da-3112-4d72-bd0f-b4132b1d891d req-75a43f6a-7d10-4399-a2be-653c6662f6da service nova] Acquiring lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40ac58da-3112-4d72-bd0f-b4132b1d891d req-75a43f6a-7d10-4399-a2be-653c6662f6da service nova] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-40ac58da-3112-4d72-bd0f-b4132b1d891d req-75a43f6a-7d10-4399-a2be-653c6662f6da service nova] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-40ac58da-3112-4d72-bd0f-b4132b1d891d req-75a43f6a-7d10-4399-a2be-653c6662f6da service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] No waiting events found dispatching network-vif-unplugged-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-40ac58da-3112-4d72-bd0f-b4132b1d891d req-75a43f6a-7d10-4399-a2be-653c6662f6da service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received event network-vif-unplugged-f89ade50-f29e-444e-a2fe-135804fe0477 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:42:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Instance destroyed successfully.
Nov 27 04:42:28 user nova-compute[75260]: DEBUG nova.objects.instance [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lazy-loading 'resources' on Instance uuid e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:39:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1347401076',display_name='tempest-VolumesAssistedSnapshotsTest-server-1347401076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1347401076',id=10,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcaoPsfC5YU5I4UbqhbwR80THAktxmtsDo38xNYkDV5J2KlU3kb944GgNFag/AsgycKeqYyUJo1LlQOJ6IghaD5/j9a5D9ENN2baD7+Q73nLZ7Yk6Yo4zOEfEyXFJDPCA==',key_name='tempest-keypair-928995188',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d663e698af432892b2131e20ad91f7',ramdisk_id='',reservation_id='r-kfv5h403',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1845923318',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1845923318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999c2cafc10e4b6c88d711e46359f36c',uuid=e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Converting VIF {"id": "f89ade50-f29e-444e-a2fe-135804fe0477", "address": "fa:16:3e:62:72:fb", "network": {"id": "019d0aea-cd70-4421-b9c6-ba801817a98c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1021268028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d663e698af432892b2131e20ad91f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89ade50-f2", "ovs_interfaceid": "f89ade50-f29e-444e-a2fe-135804fe0477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:72:fb,bridge_name='br-int',has_traffic_filtering=True,id=f89ade50-f29e-444e-a2fe-135804fe0477,network=Network(019d0aea-cd70-4421-b9c6-ba801817a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89ade50-f2') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG os_vif [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:72:fb,bridge_name='br-int',has_traffic_filtering=True,id=f89ade50-f29e-444e-a2fe-135804fe0477,network=Network(019d0aea-cd70-4421-b9c6-ba801817a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89ade50-f2') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf89ade50-f2, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e776cd8-1b0c-4664-afda-9baca3a2cbb3) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:28 user nova-compute[75260]: INFO os_vif [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:72:fb,bridge_name='br-int',has_traffic_filtering=True,id=f89ade50-f29e-444e-a2fe-135804fe0477,network=Network(019d0aea-cd70-4421-b9c6-ba801817a98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89ade50-f2')
Nov 27 04:42:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Deleting instance files /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402_del
Nov 27 04:42:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Deletion of /opt/stack/data/nova/instances/e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402_del complete
Nov 27 04:42:28 user nova-compute[75260]: INFO nova.compute.manager [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 27 04:42:28 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:42:28 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:42:29 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:29 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Took 0.76 seconds to deallocate network for instance.
Nov 27 04:42:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:29 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:42:29 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:42:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:29 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Deleted allocations for instance e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402
Nov 27 04:42:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cc6e2773-895a-499b-829e-96820c25de28 tempest-VolumesAssistedSnapshotsTest-1845923318 tempest-VolumesAssistedSnapshotsTest-1845923318-project-member] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.140s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-9c94b263-e041-4444-8160-98b3ed35c504 req-851ee571-1a42-456a-a0fa-392f27e9b182 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received event network-vif-plugged-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9c94b263-e041-4444-8160-98b3ed35c504 req-851ee571-1a42-456a-a0fa-392f27e9b182 service nova] Acquiring lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9c94b263-e041-4444-8160-98b3ed35c504 req-851ee571-1a42-456a-a0fa-392f27e9b182 service nova] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9c94b263-e041-4444-8160-98b3ed35c504 req-851ee571-1a42-456a-a0fa-392f27e9b182 service nova] Lock "e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-9c94b263-e041-4444-8160-98b3ed35c504 req-851ee571-1a42-456a-a0fa-392f27e9b182 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] No waiting events found dispatching network-vif-plugged-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:29 user nova-compute[75260]: WARNING nova.compute.manager [req-9c94b263-e041-4444-8160-98b3ed35c504 req-851ee571-1a42-456a-a0fa-392f27e9b182 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received unexpected event network-vif-plugged-f89ade50-f29e-444e-a2fe-135804fe0477 for instance with vm_state deleted and task_state None.
Nov 27 04:42:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-9c94b263-e041-4444-8160-98b3ed35c504 req-851ee571-1a42-456a-a0fa-392f27e9b182 service nova] [instance: e54cd8dd-9b72-4f8f-b9ab-40e71bb4a402] Received event network-vif-deleted-f89ade50-f29e-444e-a2fe-135804fe0477 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:42:35 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:42:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:36 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:42:36 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:42:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:36 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:42:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:42:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:42:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:41 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:42:41 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7906MB free_disk=25.562427520751953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 12efb820-12ab-442d-a5fe-80b08f12a729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d47665e4-157a-46e2-85a3-1c5cde99db1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance cd971ad8-53b2-4088-9133-862ab89dc27e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance a5543a82-a320-4119-8d6e-0476226d619b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance b25602f8-d770-4f4e-afe7-523676170a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance f29b0503-13ae-4efa-99cf-07b30dbfd2f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:42:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG nova.objects.instance [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lazy-loading 'flavor' on Instance uuid 3d96ab7b-3690-424e-96da-5e69b1bb1e90 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:42 user nova-compute[75260]: INFO nova.compute.manager [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Attaching volume 47c204d7-0a62-4fec-bba4-635ccecba25f to /dev/vdb
Nov 27 04:42:42 user nova-compute[75260]: DEBUG os_brick.utils [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2f3cb4-30a0-4a32-ba22-6446a5370bcc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[870cffad-514c-40c9-9ca5-1123c78c0298]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2472c0c-0543-4e4c-82d4-5f9bc056f65c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[55589859-6e97-41f0-ac1d-ebd4dc6657ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:42:42 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eb3922-0349-403f-a207-d73bfed23b6a]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG os_brick.utils [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating existing volume attachment record: 0b14706c-4948-47cd-9fcb-7528e30086a1 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:42:42 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:42:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:43 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Updating instance_info_cache with network_info: [{"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-d47665e4-157a-46e2-85a3-1c5cde99db1a" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:42:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:42:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:42:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:42:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:42:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:42:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquired lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'info_cache' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.objects.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updating instance_info_cache with network_info: [{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Releasing lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:42:48 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance destroyed successfully.
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'resources' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.objects.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658059163',display_name='tempest-AttachVolumeTestJSON-server-658059163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658059163',id=3,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/GFJ1RKiLPqz1av9ONhStQdrFP19obKkEGU7x+pfBUqsksA5dF6EGjTzeKbXRH4TNzkcH/co8UJKydluZFyoGJur/nedX5G2Wm9SLqgk6epiltTyDcIWj5HSqtnqbSFA==',key_name='tempest-keypair-531623201',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-4gzgeom6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=12efb820-12ab-442d-a5fe-80b08f12a729,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_vif [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape07f49c0-b8, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6d64040-711b-4719-bd4e-f6b8647c0923) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:48 user nova-compute[75260]: INFO os_vif [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8')
Nov 27 04:42:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnWiRhvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:42:48 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3ff3d7-aa6f-4d44-be90-e5988ec0e229]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:42:48 user nova-compute[75260]: No targets found.
Nov 27 04:42:48 user nova-compute[75260]: iSNS:
Nov 27 04:42:48 user nova-compute[75260]: No targets found.
Nov 27 04:42:48 user nova-compute[75260]: STATIC:
Nov 27 04:42:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:42:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:42:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:48 user nova-compute[75260]: FIRMWARE:
Nov 27 04:42:48 user nova-compute[75260]: No targets found.
Nov 27 04:42:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:42:48 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:42:48 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d93cad-3fde-488b-8bba-e0033fa64aa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbebd82-e261-408d-afca-90b9bcba2bdb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:48 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:42:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:48 user nova-compute[75260]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:42:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb542417e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa'): ({'sdi'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Removing single pathed devices sdi {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeaff0b-c2f9-47b1-b117-cf0fb7607107]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f3e643-4bd5-4ab4-ad3f-51140552b3c5]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flushing IO for device /dev/sdi {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8220df-d695-4972-a9de-64ac1bad82a2]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab262db1-c032-434e-b8d9-a2a5e0e6fc37]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] SCSI volumes sdi have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:42:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d260b-f492-4fd5-bd39-a22daf40ec20]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:42:49 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.193s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4818360f-d2cc-47b1-94f3-9800df882bac]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260]
Nov 27 04:42:49 user nova-compute[75260]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260] successful.
Nov 27 04:42:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9421576c-b668-4bea-8c77-680e9b29be79]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== disconnect_volume: return (482ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.240s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:42:49 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:42:49 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Start _get_guest_xml network_info=[{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'bcb82cd5-7fa8-404b-8298-9efe90bb26f1', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnWiRhvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '12efb820-12ab-442d-a5fe-80b08f12a729', 'attached_at': '', 'detached_at': '', 'volume_id': '01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa', 'serial': '01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'numa_topology' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260" returned: 21 in 0.127s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29fe9bb-d8ad-4660-8ed4-959f62576cae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:42:49 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6afa8b-a2d9-460a-b1b0-14ae3c044380]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f] added
Nov 27 04:42:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.objects.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.046s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecbd228-41e5-42ca-8b45-d5d8eb317789]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:42:49 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'vcpu_model' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a79d21d-de76-404f-8803-f366424c0e26]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXmcrsSB {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.objects.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnWiRhvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:42:49 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXmcrsSB" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b095fe-f3b3-4b62-a32b-19c551b22d6f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXmcrsSB'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6e725b-734c-48ef-a3d3-449c1eba2525]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb6e020-41d4-4018-b78d-7201f666a93a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:49 user nova-compute[75260]: INFO nova.compute.manager [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Terminating instance
Nov 27 04:42:49 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cf90e2-c876-463d-ac3b-2cc00ed59937]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]
Nov 27 04:42:49 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.
Nov 27 04:42:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.066s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[befb934b-8754-4cdb-aff1-ded339cf5ebf]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b1855b-a5bf-4de8-a5b5-4721259b66e2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:49 user nova-compute[75260]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:42:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:49 user nova-compute[75260]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:42:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.529s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3480a8c2-f69c-4949-ba4d-16d1b6628651]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-4d826807-66a0-49a8-9185-2d3a95a0755f req-55a2ef65-c1f0-4f38-bd2a-5a03d9f51df0 service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received event network-vif-unplugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4d826807-66a0-49a8-9185-2d3a95a0755f req-55a2ef65-c1f0-4f38-bd2a-5a03d9f51df0 service nova] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4d826807-66a0-49a8-9185-2d3a95a0755f req-55a2ef65-c1f0-4f38-bd2a-5a03d9f51df0 service nova] Lock "a5543a82-a320-4119-8d6e-0476226d619b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4d826807-66a0-49a8-9185-2d3a95a0755f req-55a2ef65-c1f0-4f38-bd2a-5a03d9f51df0 service nova] Lock "a5543a82-a320-4119-8d6e-0476226d619b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-4d826807-66a0-49a8-9185-2d3a95a0755f req-55a2ef65-c1f0-4f38-bd2a-5a03d9f51df0 service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] No waiting events found dispatching network-vif-unplugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-4d826807-66a0-49a8-9185-2d3a95a0755f req-55a2ef65-c1f0-4f38-bd2a-5a03d9f51df0 service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received event network-vif-unplugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:42:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Instance destroyed successfully.
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lazy-loading 'resources' on Instance uuid a5543a82-a320-4119-8d6e-0476226d619b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:39:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2063690473',display_name='tempest-TestVolumeSwap-server-2063690473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2063690473',id=7,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV7eYYE/k4zvO6ojfXeJUUqXDyjsSauljPPvQw1xp/HLqVSvNNt86kBHQqKoVUQBLgel/xjm4squ/K9b8EeC+kUxQb8MkPAGwBxUnpAzXKwX+01PmO1ehGOAT4JcMHTXw==',key_name='tempest-keypair-1202017415',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf53df145f6844abaef38dd56dd36141',ramdisk_id='',reservation_id='r-ksycurcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1829398268',owner_user_name='tempest-TestVolumeSwap-1829398268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81da03a2818445ea39db206249f594a',uuid=a5543a82-a320-4119-8d6e-0476226d619b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Converting VIF {"id": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "address": "fa:16:3e:a2:3c:e1", "network": {"id": "c780b17d-c298-4ecd-be85-7d076cebf4cb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096275414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf53df145f6844abaef38dd56dd36141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fe9246-07", "ovs_interfaceid": "98fe9246-07fb-4d29-bdb3-46459e0e2303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:3c:e1,bridge_name='br-int',has_traffic_filtering=True,id=98fe9246-07fb-4d29-bdb3-46459e0e2303,network=Network(c780b17d-c298-4ecd-be85-7d076cebf4cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fe9246-07') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_vif [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:3c:e1,bridge_name='br-int',has_traffic_filtering=True,id=98fe9246-07fb-4d29-bdb3-46459e0e2303,network=Network(c780b17d-c298-4ecd-be85-7d076cebf4cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fe9246-07') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98fe9246-07, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31912f13-fa56-4435-be26-b732b6be7910) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:50 user nova-compute[75260]: INFO os_vif [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:3c:e1,bridge_name='br-int',has_traffic_filtering=True,id=98fe9246-07fb-4d29-bdb3-46459e0e2303,network=Network(c780b17d-c298-4ecd-be85-7d076cebf4cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fe9246-07')
Nov 27 04:42:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Deleting instance files /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b_del
Nov 27 04:42:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Deletion of /opt/stack/data/nova/instances/a5543a82-a320-4119-8d6e-0476226d619b_del complete
Nov 27 04:42:50 user nova-compute[75260]: INFO nova.compute.manager [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: a5543a82-a320-4119-8d6e-0476226d619b] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.579s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] <== connect_volume: return (1820ms) {'type': 'block', 'scsi_wwn': '26438393036623231', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438393036623231', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.276s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:42:50 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:42:50 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.objects.instance [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lazy-loading 'flavor' on Instance uuid 3d96ab7b-3690-424e-96da-5e69b1bb1e90 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[719755b9-8ff6-4db1-bfd4-3b6e2fec80c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:42:50 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:42:50 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:42:50 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:42:50 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:42:50 user nova-compute[75260]:   <serial>47c204d7-0a62-4fec-bba4-635ccecba25f</serial>
Nov 27 04:42:50 user nova-compute[75260]: </disk>
Nov 27 04:42:50 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1379114-f08b-4a78-a1e5-adee8ca2cb36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa] added
Nov 27 04:42:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaa6de1-acb4-4046-9c6d-823f2acc2d66]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f32019-5d0e-49f9-8899-4ec82aa0666a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gnWiRhvk {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gnWiRhvk" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2674c58-fe69-4be1-b31b-4e88f2b3f1ed]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gnWiRhvk'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf7738b-5013-4699-8965-df01523fc993]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bd6aa7-f66a-48e7-9b02-d7fc42695dc0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:51 user nova-compute[75260]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:42:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:51 user nova-compute[75260]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:42:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb2914e-362d-47ed-b086-fe057249ba59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260]
Nov 27 04:42:51 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260] successful.
Nov 27 04:42:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[30346db0-9127-4194-83ba-d268d70d5986]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fbf6f4-faa9-497e-9ea1-7a992224658b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:51 user nova-compute[75260]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:42:51 user nova-compute[75260]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:42:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:51 user nova-compute[75260]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:42:51 user nova-compute[75260]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:42:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c09d990-0320-4216-81e2-07ba59a229e0]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnWiRhvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] No VIF found with MAC fa:16:3e:aa:95:ab, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-71655c64-6645-49dd-9df2-68495dd43185 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.073s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:51 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Took 0.90 seconds to deallocate network for instance.
Nov 27 04:42:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-f71e1b39-4d4f-463c-952d-1f3cc7d17e88 req-29d61667-376a-47d9-8f60-3aa767f738ab service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received event network-vif-deleted-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:52 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Deleted allocations for instance a5543a82-a320-4119-8d6e-0476226d619b
Nov 27 04:42:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== connect_volume: return (2661ms) {'type': 'block', 'scsi_wwn': '23461623262663137', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461623262663137', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658059163',display_name='tempest-AttachVolumeTestJSON-server-658059163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658059163',id=3,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/GFJ1RKiLPqz1av9ONhStQdrFP19obKkEGU7x+pfBUqsksA5dF6EGjTzeKbXRH4TNzkcH/co8UJKydluZFyoGJur/nedX5G2Wm9SLqgk6epiltTyDcIWj5HSqtnqbSFA==',key_name='tempest-keypair-531623201',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-4gzgeom6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=12efb820-12ab-442d-a5fe-80b08f12a729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'pci_devices' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.objects.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:42:52 user nova-compute[75260]:   <uuid>12efb820-12ab-442d-a5fe-80b08f12a729</uuid>
Nov 27 04:42:52 user nova-compute[75260]:   <name>instance-00000003</name>
Nov 27 04:42:52 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:42:52 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:42:52 user nova-compute[75260]:   <metadata>
Nov 27 04:42:52 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:42:52 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:42:52 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeTestJSON-server-658059163</nova:name>
Nov 27 04:42:52 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:42:49</nova:creationTime>
Nov 27 04:42:52 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:42:52 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:42:52 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:42:52 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:42:52 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:42:52 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:42:52 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:42:52 user nova-compute[75260]:       <nova:owner>
Nov 27 04:42:52 user nova-compute[75260]:         <nova:user uuid="1cbd63730ab84fa3aa9a05b06194ad4a">tempest-AttachVolumeTestJSON-2145472694-project-member</nova:user>
Nov 27 04:42:52 user nova-compute[75260]:         <nova:project uuid="ea8a8bd85b234d8e82487ead1232a644">tempest-AttachVolumeTestJSON-2145472694</nova:project>
Nov 27 04:42:52 user nova-compute[75260]:       </nova:owner>
Nov 27 04:42:52 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:42:52 user nova-compute[75260]:       <nova:ports>
Nov 27 04:42:52 user nova-compute[75260]:         <nova:port uuid="e07f49c0-b893-44bf-a195-c351eadfe333">
Nov 27 04:42:52 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 04:42:52 user nova-compute[75260]:         </nova:port>
Nov 27 04:42:52 user nova-compute[75260]:       </nova:ports>
Nov 27 04:42:52 user nova-compute[75260]:     </nova:instance>
Nov 27 04:42:52 user nova-compute[75260]:   </metadata>
Nov 27 04:42:52 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:42:52 user nova-compute[75260]:     <system>
Nov 27 04:42:52 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:42:52 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:42:52 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:42:52 user nova-compute[75260]:       <entry name="serial">12efb820-12ab-442d-a5fe-80b08f12a729</entry>
Nov 27 04:42:52 user nova-compute[75260]:       <entry name="uuid">12efb820-12ab-442d-a5fe-80b08f12a729</entry>
Nov 27 04:42:52 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:42:52 user nova-compute[75260]:     </system>
Nov 27 04:42:52 user nova-compute[75260]:   </sysinfo>
Nov 27 04:42:52 user nova-compute[75260]:   <os>
Nov 27 04:42:52 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:42:52 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:42:52 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:42:52 user nova-compute[75260]:   </os>
Nov 27 04:42:52 user nova-compute[75260]:   <features>
Nov 27 04:42:52 user nova-compute[75260]:     <acpi/>
Nov 27 04:42:52 user nova-compute[75260]:     <apic/>
Nov 27 04:42:52 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:42:52 user nova-compute[75260]:   </features>
Nov 27 04:42:52 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:42:52 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:42:52 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:42:52 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:42:52 user nova-compute[75260]:   </clock>
Nov 27 04:42:52 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:42:52 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:42:52 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:42:52 user nova-compute[75260]:   </cpu>
Nov 27 04:42:52 user nova-compute[75260]:   <devices>
Nov 27 04:42:52 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:42:52 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:42:52 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk"/>
Nov 27 04:42:52 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:42:52 user nova-compute[75260]:     </disk>
Nov 27 04:42:52 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:42:52 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:42:52 user nova-compute[75260]:       <source dev="/dev/sdc"/>
Nov 27 04:42:52 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:42:52 user nova-compute[75260]:       <serial>01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa</serial>
Nov 27 04:42:52 user nova-compute[75260]:     </disk>
Nov 27 04:42:52 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:42:52 user nova-compute[75260]:       <mac address="fa:16:3e:7e:e4:1f"/>
Nov 27 04:42:52 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:42:52 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:42:52 user nova-compute[75260]:       <target dev="tape07f49c0-b8"/>
Nov 27 04:42:52 user nova-compute[75260]:     </interface>
Nov 27 04:42:52 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:42:52 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/console.log" append="off"/>
Nov 27 04:42:52 user nova-compute[75260]:     </serial>
Nov 27 04:42:52 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:42:52 user nova-compute[75260]:     <video>
Nov 27 04:42:52 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:42:52 user nova-compute[75260]:     </video>
Nov 27 04:42:52 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:42:52 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:42:52 user nova-compute[75260]:     </rng>
Nov 27 04:42:52 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:42:52 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:42:52 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:42:52 user nova-compute[75260]:     </memballoon>
Nov 27 04:42:52 user nova-compute[75260]:   </devices>
Nov 27 04:42:52 user nova-compute[75260]: </domain>
Nov 27 04:42:52 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8fe0f9b8-4fe1-475e-a7e9-d72ae7c49782 tempest-TestVolumeSwap-1829398268 tempest-TestVolumeSwap-1829398268-project-member] Lock "a5543a82-a320-4119-8d6e-0476226d619b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.722s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-a725280f-6ca9-4261-8fe3-d6865c66f32d req-fffda9bc-b0dd-472f-bec6-a429bc499a20 service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received event network-vif-plugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a725280f-6ca9-4261-8fe3-d6865c66f32d req-fffda9bc-b0dd-472f-bec6-a429bc499a20 service nova] Acquiring lock "a5543a82-a320-4119-8d6e-0476226d619b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a725280f-6ca9-4261-8fe3-d6865c66f32d req-fffda9bc-b0dd-472f-bec6-a429bc499a20 service nova] Lock "a5543a82-a320-4119-8d6e-0476226d619b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a725280f-6ca9-4261-8fe3-d6865c66f32d req-fffda9bc-b0dd-472f-bec6-a429bc499a20 service nova] Lock "a5543a82-a320-4119-8d6e-0476226d619b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-a725280f-6ca9-4261-8fe3-d6865c66f32d req-fffda9bc-b0dd-472f-bec6-a429bc499a20 service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] No waiting events found dispatching network-vif-plugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:52 user nova-compute[75260]: WARNING nova.compute.manager [req-a725280f-6ca9-4261-8fe3-d6865c66f32d req-fffda9bc-b0dd-472f-bec6-a429bc499a20 service nova] [instance: a5543a82-a320-4119-8d6e-0476226d619b] Received unexpected event network-vif-plugged-98fe9246-07fb-4d29-bdb3-46459e0e2303 for instance with vm_state deleted and task_state None.
Nov 27 04:42:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'trusted_certs' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG nova.objects.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.213s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Cannot resize image /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'migration_context' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.objects.base [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658059163',display_name='tempest-AttachVolumeTestJSON-server-658059163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658059163',id=3,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/GFJ1RKiLPqz1av9ONhStQdrFP19obKkEGU7x+pfBUqsksA5dF6EGjTzeKbXRH4TNzkcH/co8UJKydluZFyoGJur/nedX5G2Wm9SLqgk6epiltTyDcIWj5HSqtnqbSFA==',key_name='tempest-keypair-531623201',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-4gzgeom6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=12efb820-12ab-442d-a5fe-80b08f12a729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG os_vif [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '914d8451-7e13-5606-b344-cbb7df8842a4', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape07f49c0-b8, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape07f49c0-b8, col_values=(('qos', UUID('24398956-26df-4a21-bb94-30d3c8e217f4')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape07f49c0-b8, col_values=(('external_ids', {'iface-id': 'e07f49c0-b893-44bf-a195-c351eadfe333', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:e4:1f', 'vm-uuid': '12efb820-12ab-442d-a5fe-80b08f12a729'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:53 user nova-compute[75260]: INFO os_vif [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8')
Nov 27 04:42:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "b25602f8-d770-4f4e-afe7-523676170a0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "b25602f8-d770-4f4e-afe7-523676170a0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:53 user nova-compute[75260]: INFO nova.compute.manager [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Terminating instance
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-17291e71-da4c-409e-b17f-b4a0ed85b81a req-64e6c4bf-ed16-46f1-a3ed-8f0ea75b4190 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received event network-changed-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-17291e71-da4c-409e-b17f-b4a0ed85b81a req-64e6c4bf-ed16-46f1-a3ed-8f0ea75b4190 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Refreshing instance network info cache due to event network-changed-71c97463-4d75-4cf4-b4bc-13e6dbcae123. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-17291e71-da4c-409e-b17f-b4a0ed85b81a req-64e6c4bf-ed16-46f1-a3ed-8f0ea75b4190 service nova] Acquiring lock "refresh_cache-b25602f8-d770-4f4e-afe7-523676170a0d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-17291e71-da4c-409e-b17f-b4a0ed85b81a req-64e6c4bf-ed16-46f1-a3ed-8f0ea75b4190 service nova] Acquired lock "refresh_cache-b25602f8-d770-4f4e-afe7-523676170a0d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-17291e71-da4c-409e-b17f-b4a0ed85b81a req-64e6c4bf-ed16-46f1-a3ed-8f0ea75b4190 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Refreshing network info cache for port 71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.network.neutron [req-17291e71-da4c-409e-b17f-b4a0ed85b81a req-64e6c4bf-ed16-46f1-a3ed-8f0ea75b4190 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Updated VIF entry in instance network info cache for port 71c97463-4d75-4cf4-b4bc-13e6dbcae123. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.network.neutron [req-17291e71-da4c-409e-b17f-b4a0ed85b81a req-64e6c4bf-ed16-46f1-a3ed-8f0ea75b4190 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Updating instance_info_cache with network_info: [{"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Stashing vm_state: active {{(pid=75260) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-17291e71-da4c-409e-b17f-b4a0ed85b81a req-64e6c4bf-ed16-46f1-a3ed-8f0ea75b4190 service nova] Releasing lock "refresh_cache-b25602f8-d770-4f4e-afe7-523676170a0d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received event network-vif-unplugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] Acquiring lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] Lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] Lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] No waiting events found dispatching network-vif-unplugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received event network-vif-unplugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received event network-vif-plugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] Acquiring lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] Lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] Lock "b25602f8-d770-4f4e-afe7-523676170a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] No waiting events found dispatching network-vif-plugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:54 user nova-compute[75260]: WARNING nova.compute.manager [req-ccc2bcf4-b0ac-4f2a-a086-c2f8e75be9af req-8ed06dde-f84a-43d9-9cf4-20d4aa4bdc16 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received unexpected event network-vif-plugged-71c97463-4d75-4cf4-b4bc-13e6dbcae123 for instance with vm_state active and task_state deleting.
Nov 27 04:42:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:42:54 user nova-compute[75260]: INFO nova.compute.claims [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Claim successful on node user
Nov 27 04:42:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Instance destroyed successfully.
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.objects.instance [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'resources' on Instance uuid b25602f8-d770-4f4e-afe7-523676170a0d {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:42:54 user nova-compute[75260]: INFO nova.compute.resource_tracker [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating resource usage from migration 3108b385-0b0c-4385-a6f1-5197412862cf
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1504296527',display_name='tempest-AttachVolumeNegativeTest-server-1504296527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1504296527',id=13,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwzJaoQEPn0REogIc6sbcnZ9MgcblVeASoWq/afggJaoKzF9jRUKqczUBROtQMqaZ39B+gXQ5auVr4gw/MIFdSpGcnIdJCrUUVwne2AXeuWu5FwyUx0VS+wyfU6wGSx4g==',key_name='tempest-keypair-1657087932',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-ybz17g1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=b25602f8-d770-4f4e-afe7-523676170a0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "address": "fa:16:3e:18:aa:07", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c97463-4d", "ovs_interfaceid": "71c97463-4d75-4cf4-b4bc-13e6dbcae123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:07,bridge_name='br-int',has_traffic_filtering=True,id=71c97463-4d75-4cf4-b4bc-13e6dbcae123,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c97463-4d') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG os_vif [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:07,bridge_name='br-int',has_traffic_filtering=True,id=71c97463-4d75-4cf4-b4bc-13e6dbcae123,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c97463-4d') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71c97463-4d, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c372879-34b2-4b6f-912b-786ec8ae7b5d) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:54 user nova-compute[75260]: INFO os_vif [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:07,bridge_name='br-int',has_traffic_filtering=True,id=71c97463-4d75-4cf4-b4bc-13e6dbcae123,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c97463-4d')
Nov 27 04:42:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Deleting instance files /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d_del
Nov 27 04:42:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Deletion of /opt/stack/data/nova/instances/b25602f8-d770-4f4e-afe7-523676170a0d_del complete
Nov 27 04:42:54 user nova-compute[75260]: INFO nova.compute.manager [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Took 1.55 seconds to destroy the instance on the hypervisor.
Nov 27 04:42:54 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:42:54 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.570s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:55 user nova-compute[75260]: INFO nova.compute.manager [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Migrating
Nov 27 04:42:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:42:55 user nova-compute[75260]: INFO nova.compute.rpcapi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 27 04:42:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquired lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-949e86cc-eea2-49d6-8f95-a9a3e8a07fe3 req-1e219684-b3a6-4a0b-8289-c88b3afce085 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-949e86cc-eea2-49d6-8f95-a9a3e8a07fe3 req-1e219684-b3a6-4a0b-8289-c88b3afce085 service nova] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-949e86cc-eea2-49d6-8f95-a9a3e8a07fe3 req-1e219684-b3a6-4a0b-8289-c88b3afce085 service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-949e86cc-eea2-49d6-8f95-a9a3e8a07fe3 req-1e219684-b3a6-4a0b-8289-c88b3afce085 service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-949e86cc-eea2-49d6-8f95-a9a3e8a07fe3 req-1e219684-b3a6-4a0b-8289-c88b3afce085 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] No waiting events found dispatching network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:55 user nova-compute[75260]: WARNING nova.compute.manager [req-949e86cc-eea2-49d6-8f95-a9a3e8a07fe3 req-1e219684-b3a6-4a0b-8289-c88b3afce085 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received unexpected event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 for instance with vm_state stopped and task_state powering-on.
Nov 27 04:42:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating instance_info_cache with network_info: [{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Releasing lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Starting migrate_disk_and_power_off {{(pid=75260) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-ca47952f-5fc0-4ca2-9d46-3ec27ba565e1 req-abfd04da-0bef-40dd-8712-d184bbab2528 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Received event network-vif-deleted-71c97463-4d75-4cf4-b4bc-13e6dbcae123 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:56 user nova-compute[75260]: INFO nova.compute.manager [req-ca47952f-5fc0-4ca2-9d46-3ec27ba565e1 req-abfd04da-0bef-40dd-8712-d184bbab2528 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Neutron deleted interface 71c97463-4d75-4cf4-b4bc-13e6dbcae123; detaching it from the instance and deleting it from the info cache
Nov 27 04:42:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-ca47952f-5fc0-4ca2-9d46-3ec27ba565e1 req-abfd04da-0bef-40dd-8712-d184bbab2528 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:42:56 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Took 1.81 seconds to deallocate network for instance.
Nov 27 04:42:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-ca47952f-5fc0-4ca2-9d46-3ec27ba565e1 req-abfd04da-0bef-40dd-8712-d184bbab2528 service nova] [instance: b25602f8-d770-4f4e-afe7-523676170a0d] Detach interface failed, port_id=71c97463-4d75-4cf4-b4bc-13e6dbcae123, reason: Instance b25602f8-d770-4f4e-afe7-523676170a0d could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:56 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance destroyed successfully.
Nov 27 04:42:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1986422466',display_name='tempest-ServerActionsTestOtherB-server-1986422466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1986422466',id=5,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFB4NlyIkvuSkKdp9SCBvCksg0T5Mnmhzu1gg97fKizA6KbOPtAhyX+dbdgThddRNEEVcx1W9A9Raajm8WlZrhxaZj1ByekP4XOJKsLxLKWygxJTACdG4AQr3SivYfkcQ==',key_name='tempest-keypair-1211691950',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd8fd68d8c94c95908b4cd7c80082d5',ramdisk_id='',reservation_id='r-sfca6us3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1382636293',owner_user_name='tempest-ServerActionsTestOtherB-1382636293-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a14d60620b674141a4f714eac61c29d5',uuid=3d96ab7b-3690-424e-96da-5e69b1bb1e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1236435616-network", "vif_mac": "fa:16:3e:aa:95:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converting VIF {"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1236435616-network", "vif_mac": "fa:16:3e:aa:95:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG os_vif [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cb5862a-fc, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a017b0c-d2c9-4b18-bb4d-4ad8df553285) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:56 user nova-compute[75260]: INFO os_vif [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc')
Nov 27 04:42:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:42:56 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:42:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:42:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a00c508-7c21-4a3e-94c2-800d1876f135]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:42:57 user nova-compute[75260]: No targets found.
Nov 27 04:42:57 user nova-compute[75260]: iSNS:
Nov 27 04:42:57 user nova-compute[75260]: No targets found.
Nov 27 04:42:57 user nova-compute[75260]: STATIC:
Nov 27 04:42:57 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:42:57 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:57 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:57 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:42:57 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:57 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:57 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f
Nov 27 04:42:57 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:42:57 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:42:57 user nova-compute[75260]: FIRMWARE:
Nov 27 04:42:57 user nova-compute[75260]: No targets found.
Nov 27 04:42:57 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:42:57 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:42:57 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58f69fa-40ef-41ae-8fcb-b3a6873e05f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa2785d-6cf4-4f95-bf81-c6e911d09c92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:57 user nova-compute[75260]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:42:57 user nova-compute[75260]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:42:57 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:42:57 user nova-compute[75260]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:42:57 user nova-compute[75260]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:42:57 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54256710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfbe2d6-fe23-47cf-a23b-44306228f889]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0dc853-5322-4fe2-9fc8-2b27a3efab2a]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba2ddea-a5b4-45aa-8f96-f71dd1d3a16c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[738ae39b-f4e6-4b2d-9a87-92c6701e261f]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f884e44-5f87-403e-acdb-1919453ad859]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96304eb-f294-4c63-af10-8b2fb994b9ad]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]
Nov 27 04:42:57 user nova-compute[75260]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.
Nov 27 04:42:57 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0ca9ed-e3fa-4e9a-b12d-bda3084dd054]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] <== disconnect_volume: return (352ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Deleted allocations for instance b25602f8-d770-4f4e-afe7-523676170a0d
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1ec30db9-6793-4e30-8040-8bdffe447dd4 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "b25602f8-d770-4f4e-afe7-523676170a0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.144s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90_resize/disk /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:42:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance rebooted successfully.
Nov 27 04:42:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2848a6af-151a-4ff4-b139-5eca2f9f139b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] No waiting events found dispatching network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:58 user nova-compute[75260]: WARNING nova.compute.manager [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received unexpected event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 for instance with vm_state active and task_state None.
Nov 27 04:42:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-unplugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-unplugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:58 user nova-compute[75260]: WARNING nova.compute.manager [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-unplugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state active and task_state resize_migrating.
Nov 27 04:42:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:42:58 user nova-compute[75260]: WARNING nova.compute.manager [req-84930bbc-1f34-479c-b23b-8364f0bc73a8 req-a27381b1-f970-453a-9296-2231b815ea57 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state active and task_state resize_migrating.
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "cp -r /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90_resize/disk /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk" returned: 0 in 0.521s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90_resize/disk.info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk.info {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "cp -r /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90_resize/disk.info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk.info" returned: 0 in 0.033s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:42:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:42:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Port 6cb5862a-fc82-4f80-820f-02082def752d binding to destination host user is already ACTIVE {{(pid=75260) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 27 04:42:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:42:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:42:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:42:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:42:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquired lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:42:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating instance_info_cache with network_info: [{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Releasing lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG os_brick.utils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a223c02-c35b-42ec-8425-071a2e919503]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a655996e-0d9d-42e0-9dcc-7fa51f4b58f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e161ab74-1211-412a-98fa-1371e341ea78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71c3d68-f538-4f58-868d-d57ec2480aa6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:43:00 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:43:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ae988d-c4d3-4e52-8052-47092645b725]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:43:00 user nova-compute[75260]: DEBUG os_brick.utils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:43:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Starting finish_migration {{(pid=75260) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 27 04:43:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance directory exists: not creating {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 04:43:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Creating image(s)
Nov 27 04:43:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.212s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:08 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk. size=21474836480 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:43:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk 21474836480 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk 21474836480" returned: 0 in 0.049s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Ensure instance console log exists: /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Start _get_guest_xml network_info=[{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1236435616-network", "vif_mac": "fa:16:3e:aa:95:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '5a75c2e7-a940-4adb-b266-ac0abd1d7237', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3d96ab7b-3690-424e-96da-5e69b1bb1e90', 'attached_at': '2023-11-27T04:43:08.000000', 'detached_at': '', 'volume_id': '47c204d7-0a62-4fec-bba4-635ccecba25f', 'serial': '47c204d7-0a62-4fec-bba4-635ccecba25f'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:43:09 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:43:09 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:43:09 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:43:09 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:43:09 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c694b5a-a3e1-486e-b34a-2624e2eeab15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:43:09 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[40321b89-0b59-46bc-9a78-7a61746854b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f] added
Nov 27 04:43:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7fde1f-97a3-4e03-9e78-4c37079778f2]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7347c0a9-cd49-4cf6-9535-10c01aa237b5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXmcrsSB {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXmcrsSB" returned: 0 in 0.075s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeacb2a-cfd8-415b-a8b3-5217f414f49f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXmcrsSB'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:43:09 user nova-compute[75260]: INFO nova.compute.claims [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Claim successful on node user
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa86f49b-4b75-4460-aa82-dfb5780bb07b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b9ee11-d719-45f6-be1e-6f5b66e39cc6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:43:09 user nova-compute[75260]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:43:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:43:09 user nova-compute[75260]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:43:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ec36ec-158d-4545-a68f-a30465f5d219]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]
Nov 27 04:43:09 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.
Nov 27 04:43:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4597ecdc-65a6-40d1-8ec8-906d4112486b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdd8ef8-dc2a-44d8-b9a8-b72b7f03a006]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:43:09 user nova-compute[75260]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:43:09 user nova-compute[75260]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:43:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:43:09 user nova-compute[75260]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:43:09 user nova-compute[75260]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:43:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.449s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[38919f81-5ea8-4dc3-bca0-e68bd07c4f9d]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:43:09 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.compute.manager [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.compute.manager [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.network.neutron [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:43:10 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.compute.manager [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.policy [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eae8deecf9a748398f0e318a54d5fd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c7fae6471154459ac5169efd57c2f9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.compute.manager [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:43:10 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Creating image(s)
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "/opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "/opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] <== connect_volume: return (1504ms) {'type': 'block', 'scsi_wwn': '26438393036623231', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438393036623231', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1986422466',display_name='tempest-ServerActionsTestOtherB-server-1986422466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1986422466',id=5,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFB4NlyIkvuSkKdp9SCBvCksg0T5Mnmhzu1gg97fKizA6KbOPtAhyX+dbdgThddRNEEVcx1W9A9Raajm8WlZrhxaZj1ByekP4XOJKsLxLKWygxJTACdG4AQr3SivYfkcQ==',key_name='tempest-keypair-1211691950',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd8fd68d8c94c95908b4cd7c80082d5',ramdisk_id='',reservation_id='r-sfca6us3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1382636293',owner_user_name='tempest-ServerActionsTestOtherB-1382636293-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a14d60620b674141a4f714eac61c29d5',uuid=3d96ab7b-3690-424e-96da-5e69b1bb1e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1236435616-network", "vif_mac": "fa:16:3e:aa:95:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converting VIF {"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1236435616-network", "vif_mac": "fa:16:3e:aa:95:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:43:10 user nova-compute[75260]:   <uuid>3d96ab7b-3690-424e-96da-5e69b1bb1e90</uuid>
Nov 27 04:43:10 user nova-compute[75260]:   <name>instance-00000005</name>
Nov 27 04:43:10 user nova-compute[75260]:   <memory>2097152</memory>
Nov 27 04:43:10 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:43:10 user nova-compute[75260]:   <metadata>
Nov 27 04:43:10 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:43:10 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:43:10 user nova-compute[75260]:       <nova:name>tempest-ServerActionsTestOtherB-server-1986422466</nova:name>
Nov 27 04:43:10 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:43:09</nova:creationTime>
Nov 27 04:43:10 user nova-compute[75260]:       <nova:flavor name="m1.small">
Nov 27 04:43:10 user nova-compute[75260]:         <nova:memory>2048</nova:memory>
Nov 27 04:43:10 user nova-compute[75260]:         <nova:disk>20</nova:disk>
Nov 27 04:43:10 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:43:10 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:43:10 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:43:10 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:43:10 user nova-compute[75260]:       <nova:owner>
Nov 27 04:43:10 user nova-compute[75260]:         <nova:user uuid="a14d60620b674141a4f714eac61c29d5">tempest-ServerActionsTestOtherB-1382636293-project-member</nova:user>
Nov 27 04:43:10 user nova-compute[75260]:         <nova:project uuid="2dd8fd68d8c94c95908b4cd7c80082d5">tempest-ServerActionsTestOtherB-1382636293</nova:project>
Nov 27 04:43:10 user nova-compute[75260]:       </nova:owner>
Nov 27 04:43:10 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:43:10 user nova-compute[75260]:       <nova:ports>
Nov 27 04:43:10 user nova-compute[75260]:         <nova:port uuid="6cb5862a-fc82-4f80-820f-02082def752d">
Nov 27 04:43:10 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 04:43:10 user nova-compute[75260]:         </nova:port>
Nov 27 04:43:10 user nova-compute[75260]:       </nova:ports>
Nov 27 04:43:10 user nova-compute[75260]:     </nova:instance>
Nov 27 04:43:10 user nova-compute[75260]:   </metadata>
Nov 27 04:43:10 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:43:10 user nova-compute[75260]:     <system>
Nov 27 04:43:10 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:43:10 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:43:10 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:43:10 user nova-compute[75260]:       <entry name="serial">3d96ab7b-3690-424e-96da-5e69b1bb1e90</entry>
Nov 27 04:43:10 user nova-compute[75260]:       <entry name="uuid">3d96ab7b-3690-424e-96da-5e69b1bb1e90</entry>
Nov 27 04:43:10 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:43:10 user nova-compute[75260]:     </system>
Nov 27 04:43:10 user nova-compute[75260]:   </sysinfo>
Nov 27 04:43:10 user nova-compute[75260]:   <os>
Nov 27 04:43:10 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:43:10 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:43:10 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:43:10 user nova-compute[75260]:   </os>
Nov 27 04:43:10 user nova-compute[75260]:   <features>
Nov 27 04:43:10 user nova-compute[75260]:     <acpi/>
Nov 27 04:43:10 user nova-compute[75260]:     <apic/>
Nov 27 04:43:10 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:43:10 user nova-compute[75260]:   </features>
Nov 27 04:43:10 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:43:10 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:43:10 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:43:10 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:43:10 user nova-compute[75260]:   </clock>
Nov 27 04:43:10 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:43:10 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:43:10 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:43:10 user nova-compute[75260]:   </cpu>
Nov 27 04:43:10 user nova-compute[75260]:   <devices>
Nov 27 04:43:10 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:43:10 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:43:10 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk"/>
Nov 27 04:43:10 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:43:10 user nova-compute[75260]:     </disk>
Nov 27 04:43:10 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:43:10 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:43:10 user nova-compute[75260]:       <source dev="/dev/sdb"/>
Nov 27 04:43:10 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:43:10 user nova-compute[75260]:       <serial>47c204d7-0a62-4fec-bba4-635ccecba25f</serial>
Nov 27 04:43:10 user nova-compute[75260]:     </disk>
Nov 27 04:43:10 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:43:10 user nova-compute[75260]:       <mac address="fa:16:3e:aa:95:ab"/>
Nov 27 04:43:10 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:43:10 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:43:10 user nova-compute[75260]:       <target dev="tap6cb5862a-fc"/>
Nov 27 04:43:10 user nova-compute[75260]:     </interface>
Nov 27 04:43:10 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:43:10 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/console.log" append="off"/>
Nov 27 04:43:10 user nova-compute[75260]:     </serial>
Nov 27 04:43:10 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:43:10 user nova-compute[75260]:     <video>
Nov 27 04:43:10 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:43:10 user nova-compute[75260]:     </video>
Nov 27 04:43:10 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:43:10 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:43:10 user nova-compute[75260]:     </rng>
Nov 27 04:43:10 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:43:10 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:43:10 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:43:10 user nova-compute[75260]:     </memballoon>
Nov 27 04:43:10 user nova-compute[75260]:   </devices>
Nov 27 04:43:10 user nova-compute[75260]: </domain>
Nov 27 04:43:10 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1986422466',display_name='tempest-ServerActionsTestOtherB-server-1986422466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1986422466',id=5,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFB4NlyIkvuSkKdp9SCBvCksg0T5Mnmhzu1gg97fKizA6KbOPtAhyX+dbdgThddRNEEVcx1W9A9Raajm8WlZrhxaZj1ByekP4XOJKsLxLKWygxJTACdG4AQr3SivYfkcQ==',key_name='tempest-keypair-1211691950',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd8fd68d8c94c95908b4cd7c80082d5',ramdisk_id='',reservation_id='r-sfca6us3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1382636293',owner_user_name='tempest-ServerActionsTestOtherB-1382636293-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a14d60620b674141a4f714eac61c29d5',uuid=3d96ab7b-3690-424e-96da-5e69b1bb1e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1236435616-network", "vif_mac": "fa:16:3e:aa:95:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converting VIF {"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1236435616-network", "vif_mac": "fa:16:3e:aa:95:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG os_vif [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9076afbe-9d15-54b9-907f-abfa4e0b995b', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cb5862a-fc, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cb5862a-fc, col_values=(('qos', UUID('0d667284-a173-450f-8f2e-da2220d3e46a')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cb5862a-fc, col_values=(('external_ids', {'iface-id': '6cb5862a-fc82-4f80-820f-02082def752d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:95:ab', 'vm-uuid': '3d96ab7b-3690-424e-96da-5e69b1bb1e90'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:10 user nova-compute[75260]: INFO os_vif [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc')
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.200s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.network.neutron [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Successfully created port: e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk 1073741824" returned: 0 in 0.067s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] No VIF found with MAC fa:16:3e:aa:95:ab, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.212s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Cannot resize image /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Ensure instance console log exists: /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.network.neutron [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Successfully updated port: e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "refresh_cache-2e5dcd4e-21fc-461e-bd84-9d5feca96734" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquired lock "refresh_cache-2e5dcd4e-21fc-461e-bd84-9d5feca96734" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.network.neutron [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-db5ffbb8-085c-406a-8b31-abd1018290b7 req-e8f1f5d8-53a6-4217-8611-d2a06f4efc42 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-changed-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-db5ffbb8-085c-406a-8b31-abd1018290b7 req-e8f1f5d8-53a6-4217-8611-d2a06f4efc42 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Refreshing instance network info cache due to event network-changed-e4af270f-11b4-47d9-940a-d6447490c06c. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-db5ffbb8-085c-406a-8b31-abd1018290b7 req-e8f1f5d8-53a6-4217-8611-d2a06f4efc42 service nova] Acquiring lock "refresh_cache-2e5dcd4e-21fc-461e-bd84-9d5feca96734" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:43:11 user nova-compute[75260]: DEBUG nova.network.neutron [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.network.neutron [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Updating instance_info_cache with network_info: [{"id": "e4af270f-11b4-47d9-940a-d6447490c06c", "address": "fa:16:3e:b0:c8:65", "network": {"id": "92316a04-44f8-4c59-88af-e3da3be0233b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1548678715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7fae6471154459ac5169efd57c2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4af270f-11", "ovs_interfaceid": "e4af270f-11b4-47d9-940a-d6447490c06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Releasing lock "refresh_cache-2e5dcd4e-21fc-461e-bd84-9d5feca96734" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Instance network_info: |[{"id": "e4af270f-11b4-47d9-940a-d6447490c06c", "address": "fa:16:3e:b0:c8:65", "network": {"id": "92316a04-44f8-4c59-88af-e3da3be0233b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1548678715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7fae6471154459ac5169efd57c2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4af270f-11", "ovs_interfaceid": "e4af270f-11b4-47d9-940a-d6447490c06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-db5ffbb8-085c-406a-8b31-abd1018290b7 req-e8f1f5d8-53a6-4217-8611-d2a06f4efc42 service nova] Acquired lock "refresh_cache-2e5dcd4e-21fc-461e-bd84-9d5feca96734" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.network.neutron [req-db5ffbb8-085c-406a-8b31-abd1018290b7 req-e8f1f5d8-53a6-4217-8611-d2a06f4efc42 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Refreshing network info cache for port e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Start _get_guest_xml network_info=[{"id": "e4af270f-11b4-47d9-940a-d6447490c06c", "address": "fa:16:3e:b0:c8:65", "network": {"id": "92316a04-44f8-4c59-88af-e3da3be0233b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1548678715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7fae6471154459ac5169efd57c2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4af270f-11", "ovs_interfaceid": "e4af270f-11b4-47d9-940a-d6447490c06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:43:12 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:43:12 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1028767430',display_name='tempest-DeleteServersTestJSON-server-1028767430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1028767430',id=15,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7fae6471154459ac5169efd57c2f9f',ramdisk_id='',reservation_id='r-b7nfwfcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1858595482',owner_user_name='tempest-DeleteServersTestJSON-1858595482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:43:10Z,user_data=None,user_id='eae8deecf9a748398f0e318a54d5fd2a',uuid=2e5dcd4e-21fc-461e-bd84-9d5feca96734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4af270f-11b4-47d9-940a-d6447490c06c", "address": "fa:16:3e:b0:c8:65", "network": {"id": "92316a04-44f8-4c59-88af-e3da3be0233b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1548678715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7fae6471154459ac5169efd57c2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4af270f-11", "ovs_interfaceid": "e4af270f-11b4-47d9-940a-d6447490c06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Converting VIF {"id": "e4af270f-11b4-47d9-940a-d6447490c06c", "address": "fa:16:3e:b0:c8:65", "network": {"id": "92316a04-44f8-4c59-88af-e3da3be0233b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1548678715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7fae6471154459ac5169efd57c2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4af270f-11", "ovs_interfaceid": "e4af270f-11b4-47d9-940a-d6447490c06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c8:65,bridge_name='br-int',has_traffic_filtering=True,id=e4af270f-11b4-47d9-940a-d6447490c06c,network=Network(92316a04-44f8-4c59-88af-e3da3be0233b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4af270f-11') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.objects.instance [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e5dcd4e-21fc-461e-bd84-9d5feca96734 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:43:12 user nova-compute[75260]:   <uuid>2e5dcd4e-21fc-461e-bd84-9d5feca96734</uuid>
Nov 27 04:43:12 user nova-compute[75260]:   <name>instance-0000000f</name>
Nov 27 04:43:12 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:43:12 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:43:12 user nova-compute[75260]:   <metadata>
Nov 27 04:43:12 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:43:12 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:43:12 user nova-compute[75260]:       <nova:name>tempest-DeleteServersTestJSON-server-1028767430</nova:name>
Nov 27 04:43:12 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:43:12</nova:creationTime>
Nov 27 04:43:12 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:43:12 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:43:12 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:43:12 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:43:12 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:43:12 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:43:12 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:43:12 user nova-compute[75260]:       <nova:owner>
Nov 27 04:43:12 user nova-compute[75260]:         <nova:user uuid="eae8deecf9a748398f0e318a54d5fd2a">tempest-DeleteServersTestJSON-1858595482-project-member</nova:user>
Nov 27 04:43:12 user nova-compute[75260]:         <nova:project uuid="2c7fae6471154459ac5169efd57c2f9f">tempest-DeleteServersTestJSON-1858595482</nova:project>
Nov 27 04:43:12 user nova-compute[75260]:       </nova:owner>
Nov 27 04:43:12 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:43:12 user nova-compute[75260]:       <nova:ports>
Nov 27 04:43:12 user nova-compute[75260]:         <nova:port uuid="e4af270f-11b4-47d9-940a-d6447490c06c">
Nov 27 04:43:12 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:43:12 user nova-compute[75260]:         </nova:port>
Nov 27 04:43:12 user nova-compute[75260]:       </nova:ports>
Nov 27 04:43:12 user nova-compute[75260]:     </nova:instance>
Nov 27 04:43:12 user nova-compute[75260]:   </metadata>
Nov 27 04:43:12 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:43:12 user nova-compute[75260]:     <system>
Nov 27 04:43:12 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:43:12 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:43:12 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:43:12 user nova-compute[75260]:       <entry name="serial">2e5dcd4e-21fc-461e-bd84-9d5feca96734</entry>
Nov 27 04:43:12 user nova-compute[75260]:       <entry name="uuid">2e5dcd4e-21fc-461e-bd84-9d5feca96734</entry>
Nov 27 04:43:12 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:43:12 user nova-compute[75260]:     </system>
Nov 27 04:43:12 user nova-compute[75260]:   </sysinfo>
Nov 27 04:43:12 user nova-compute[75260]:   <os>
Nov 27 04:43:12 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:43:12 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:43:12 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:43:12 user nova-compute[75260]:   </os>
Nov 27 04:43:12 user nova-compute[75260]:   <features>
Nov 27 04:43:12 user nova-compute[75260]:     <acpi/>
Nov 27 04:43:12 user nova-compute[75260]:     <apic/>
Nov 27 04:43:12 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:43:12 user nova-compute[75260]:   </features>
Nov 27 04:43:12 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:43:12 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:43:12 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:43:12 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:43:12 user nova-compute[75260]:   </clock>
Nov 27 04:43:12 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:43:12 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:43:12 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:43:12 user nova-compute[75260]:   </cpu>
Nov 27 04:43:12 user nova-compute[75260]:   <devices>
Nov 27 04:43:12 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:43:12 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:43:12 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk"/>
Nov 27 04:43:12 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:43:12 user nova-compute[75260]:     </disk>
Nov 27 04:43:12 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:43:12 user nova-compute[75260]:       <mac address="fa:16:3e:b0:c8:65"/>
Nov 27 04:43:12 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:43:12 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:43:12 user nova-compute[75260]:       <target dev="tape4af270f-11"/>
Nov 27 04:43:12 user nova-compute[75260]:     </interface>
Nov 27 04:43:12 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:43:12 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/console.log" append="off"/>
Nov 27 04:43:12 user nova-compute[75260]:     </serial>
Nov 27 04:43:12 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:43:12 user nova-compute[75260]:     <video>
Nov 27 04:43:12 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:43:12 user nova-compute[75260]:     </video>
Nov 27 04:43:12 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:43:12 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:43:12 user nova-compute[75260]:     </rng>
Nov 27 04:43:12 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:43:12 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:43:12 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:43:12 user nova-compute[75260]:     </memballoon>
Nov 27 04:43:12 user nova-compute[75260]:   </devices>
Nov 27 04:43:12 user nova-compute[75260]: </domain>
Nov 27 04:43:12 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1028767430',display_name='tempest-DeleteServersTestJSON-server-1028767430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1028767430',id=15,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7fae6471154459ac5169efd57c2f9f',ramdisk_id='',reservation_id='r-b7nfwfcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1858595482',owner_user_name='tempest-DeleteServersTestJSON-1858595482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:43:10Z,user_data=None,user_id='eae8deecf9a748398f0e318a54d5fd2a',uuid=2e5dcd4e-21fc-461e-bd84-9d5feca96734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4af270f-11b4-47d9-940a-d6447490c06c", "address": "fa:16:3e:b0:c8:65", "network": {"id": "92316a04-44f8-4c59-88af-e3da3be0233b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1548678715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7fae6471154459ac5169efd57c2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4af270f-11", "ovs_interfaceid": "e4af270f-11b4-47d9-940a-d6447490c06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Converting VIF {"id": "e4af270f-11b4-47d9-940a-d6447490c06c", "address": "fa:16:3e:b0:c8:65", "network": {"id": "92316a04-44f8-4c59-88af-e3da3be0233b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1548678715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7fae6471154459ac5169efd57c2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4af270f-11", "ovs_interfaceid": "e4af270f-11b4-47d9-940a-d6447490c06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c8:65,bridge_name='br-int',has_traffic_filtering=True,id=e4af270f-11b4-47d9-940a-d6447490c06c,network=Network(92316a04-44f8-4c59-88af-e3da3be0233b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4af270f-11') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG os_vif [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c8:65,bridge_name='br-int',has_traffic_filtering=True,id=e4af270f-11b4-47d9-940a-d6447490c06c,network=Network(92316a04-44f8-4c59-88af-e3da3be0233b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4af270f-11') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd679e732-6817-5e83-9055-e72e594e7e70', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4af270f-11, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4af270f-11, col_values=(('qos', UUID('4aad3a26-9378-4e18-b39c-50d49e19623b')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4af270f-11, col_values=(('external_ids', {'iface-id': 'e4af270f-11b4-47d9-940a-d6447490c06c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:c8:65', 'vm-uuid': '2e5dcd4e-21fc-461e-bd84-9d5feca96734'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:12 user nova-compute[75260]: INFO os_vif [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c8:65,bridge_name='br-int',has_traffic_filtering=True,id=e4af270f-11b4-47d9-940a-d6447490c06c,network=Network(92316a04-44f8-4c59-88af-e3da3be0233b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4af270f-11')
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] No VIF found with MAC fa:16:3e:b0:c8:65, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.network.neutron [req-db5ffbb8-085c-406a-8b31-abd1018290b7 req-e8f1f5d8-53a6-4217-8611-d2a06f4efc42 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Updated VIF entry in instance network info cache for port e4af270f-11b4-47d9-940a-d6447490c06c. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.network.neutron [req-db5ffbb8-085c-406a-8b31-abd1018290b7 req-e8f1f5d8-53a6-4217-8611-d2a06f4efc42 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Updating instance_info_cache with network_info: [{"id": "e4af270f-11b4-47d9-940a-d6447490c06c", "address": "fa:16:3e:b0:c8:65", "network": {"id": "92316a04-44f8-4c59-88af-e3da3be0233b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1548678715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7fae6471154459ac5169efd57c2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4af270f-11", "ovs_interfaceid": "e4af270f-11b4-47d9-940a-d6447490c06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-db5ffbb8-085c-406a-8b31-abd1018290b7 req-e8f1f5d8-53a6-4217-8611-d2a06f4efc42 service nova] Releasing lock "refresh_cache-2e5dcd4e-21fc-461e-bd84-9d5feca96734" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-361249e0-5c54-42a8-b1d6-36aa6107d015 req-075bde5c-4052-4d0a-9893-ef172b651abe service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-361249e0-5c54-42a8-b1d6-36aa6107d015 req-075bde5c-4052-4d0a-9893-ef172b651abe service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-361249e0-5c54-42a8-b1d6-36aa6107d015 req-075bde5c-4052-4d0a-9893-ef172b651abe service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-361249e0-5c54-42a8-b1d6-36aa6107d015 req-075bde5c-4052-4d0a-9893-ef172b651abe service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-361249e0-5c54-42a8-b1d6-36aa6107d015 req-075bde5c-4052-4d0a-9893-ef172b651abe service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:12 user nova-compute[75260]: WARNING nova.compute.manager [req-361249e0-5c54-42a8-b1d6-36aa6107d015 req-075bde5c-4052-4d0a-9893-ef172b651abe service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state active and task_state resize_finish.
Nov 27 04:43:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:14 user nova-compute[75260]: WARNING nova.compute.manager [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state active and task_state resize_finish.
Nov 27 04:43:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] No waiting events found dispatching network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:14 user nova-compute[75260]: WARNING nova.compute.manager [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received unexpected event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c for instance with vm_state building and task_state spawning.
Nov 27 04:43:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] No waiting events found dispatching network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:14 user nova-compute[75260]: WARNING nova.compute.manager [req-0f62d6dc-5841-4361-9b71-549df7e8396b req-2555a188-1899-45e5-9272-62b37dc1ac83 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received unexpected event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c for instance with vm_state building and task_state spawning.
Nov 27 04:43:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:43:16 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Instance spawned successfully.
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:16 user nova-compute[75260]: INFO nova.compute.manager [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:43:16 user nova-compute[75260]: INFO nova.compute.manager [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Took 7.32 seconds to build instance.
Nov 27 04:43:16 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance running successfully.
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Failed to set time: agent not configured {{(pid=75260) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b5d954c-7a5a-4606-985e-b0781f9a45a2 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] finish_migration finished successfully. {{(pid=75260) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 27 04:43:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-be4a7977-a813-4bf6-8e36-541b19ec6ab5 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.458s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:28 user nova-compute[75260]: INFO nova.compute.manager [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Rescuing
Nov 27 04:43:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:43:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquired lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:43:28 user nova-compute[75260]: DEBUG nova.network.neutron [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG nova.network.neutron [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updating instance_info_cache with network_info: [{"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Releasing lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-32b82a89-afda-4892-8457-2583e1fe997c req-610ffe4a-f550-4f5d-bdef-ccf40cd56410 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-unplugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-32b82a89-afda-4892-8457-2583e1fe997c req-610ffe4a-f550-4f5d-bdef-ccf40cd56410 service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-32b82a89-afda-4892-8457-2583e1fe997c req-610ffe4a-f550-4f5d-bdef-ccf40cd56410 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-32b82a89-afda-4892-8457-2583e1fe997c req-610ffe4a-f550-4f5d-bdef-ccf40cd56410 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-32b82a89-afda-4892-8457-2583e1fe997c req-610ffe4a-f550-4f5d-bdef-ccf40cd56410 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-unplugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:29 user nova-compute[75260]: WARNING nova.compute.manager [req-32b82a89-afda-4892-8457-2583e1fe997c req-610ffe4a-f550-4f5d-bdef-ccf40cd56410 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-unplugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state active and task_state rescuing.
Nov 27 04:43:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Instance destroyed successfully.
Nov 27 04:43:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Attempting rescue
Nov 27 04:43:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75260) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Instance directory exists: not creating {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 04:43:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Creating image(s)
Nov 27 04:43:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.instance [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.213s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue" returned: 0 in 0.058s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.instance [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'migration_context' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.base [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<7c01d799-540f-469b-8417-5af70d803adf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Start _get_guest_xml network_info=[{"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "vif_mac": "fa:16:3e:a5:25:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.instance [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'resources' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.base [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<7c01d799-540f-469b-8417-5af70d803adf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.instance [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.base [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<7c01d799-540f-469b-8417-5af70d803adf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:43:30 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:43:30 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.instance [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.base [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<7c01d799-540f-469b-8417-5af70d803adf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1181510226',display_name='tempest-ServerRescueNegativeTestJSON-server-1181510226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1181510226',id=1,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:38:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-3w0rf0rf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:38:57Z,user_data=None,user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=7c01d799-540f-469b-8417-5af70d803adf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "vif_mac": "fa:16:3e:a5:25:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "vif_mac": "fa:16:3e:a5:25:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:25:f7,bridge_name='br-int',has_traffic_filtering=True,id=240c5141-ac9c-45d3-ba42-5e854ceee9ed,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240c5141-ac') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.instance [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.objects.base [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<7c01d799-540f-469b-8417-5af70d803adf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:43:30 user nova-compute[75260]:   <uuid>7c01d799-540f-469b-8417-5af70d803adf</uuid>
Nov 27 04:43:30 user nova-compute[75260]:   <name>instance-00000001</name>
Nov 27 04:43:30 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:43:30 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:43:30 user nova-compute[75260]:   <metadata>
Nov 27 04:43:30 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:43:30 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:43:30 user nova-compute[75260]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1181510226</nova:name>
Nov 27 04:43:30 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:43:30</nova:creationTime>
Nov 27 04:43:30 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:43:30 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:43:30 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:43:30 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:43:30 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:43:30 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:43:30 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:43:30 user nova-compute[75260]:       <nova:owner>
Nov 27 04:43:30 user nova-compute[75260]:         <nova:user uuid="41069f4d1d404da19dcfb2a3552fcddb">tempest-ServerRescueNegativeTestJSON-1319145768-project-member</nova:user>
Nov 27 04:43:30 user nova-compute[75260]:         <nova:project uuid="0e5f7694b2294e16aec0248f1217b148">tempest-ServerRescueNegativeTestJSON-1319145768</nova:project>
Nov 27 04:43:30 user nova-compute[75260]:       </nova:owner>
Nov 27 04:43:30 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:43:30 user nova-compute[75260]:       <nova:ports>
Nov 27 04:43:30 user nova-compute[75260]:         <nova:port uuid="240c5141-ac9c-45d3-ba42-5e854ceee9ed">
Nov 27 04:43:30 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:43:30 user nova-compute[75260]:         </nova:port>
Nov 27 04:43:30 user nova-compute[75260]:       </nova:ports>
Nov 27 04:43:30 user nova-compute[75260]:     </nova:instance>
Nov 27 04:43:30 user nova-compute[75260]:   </metadata>
Nov 27 04:43:30 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:43:30 user nova-compute[75260]:     <system>
Nov 27 04:43:30 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:43:30 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:43:30 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:43:30 user nova-compute[75260]:       <entry name="serial">7c01d799-540f-469b-8417-5af70d803adf</entry>
Nov 27 04:43:30 user nova-compute[75260]:       <entry name="uuid">7c01d799-540f-469b-8417-5af70d803adf</entry>
Nov 27 04:43:30 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:43:30 user nova-compute[75260]:     </system>
Nov 27 04:43:30 user nova-compute[75260]:   </sysinfo>
Nov 27 04:43:30 user nova-compute[75260]:   <os>
Nov 27 04:43:30 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:43:30 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:43:30 user nova-compute[75260]:   </os>
Nov 27 04:43:30 user nova-compute[75260]:   <features>
Nov 27 04:43:30 user nova-compute[75260]:     <acpi/>
Nov 27 04:43:30 user nova-compute[75260]:     <apic/>
Nov 27 04:43:30 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:43:30 user nova-compute[75260]:   </features>
Nov 27 04:43:30 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:43:30 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:43:30 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:43:30 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:43:30 user nova-compute[75260]:   </clock>
Nov 27 04:43:30 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:43:30 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:43:30 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:43:30 user nova-compute[75260]:   </cpu>
Nov 27 04:43:30 user nova-compute[75260]:   <devices>
Nov 27 04:43:30 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:43:30 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:43:30 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue"/>
Nov 27 04:43:30 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:43:30 user nova-compute[75260]:     </disk>
Nov 27 04:43:30 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:43:30 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:43:30 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk"/>
Nov 27 04:43:30 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:43:30 user nova-compute[75260]:     </disk>
Nov 27 04:43:30 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:43:30 user nova-compute[75260]:       <mac address="fa:16:3e:a5:25:f7"/>
Nov 27 04:43:30 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:43:30 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:43:30 user nova-compute[75260]:       <target dev="tap240c5141-ac"/>
Nov 27 04:43:30 user nova-compute[75260]:     </interface>
Nov 27 04:43:30 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:43:30 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/console.log" append="off"/>
Nov 27 04:43:30 user nova-compute[75260]:     </serial>
Nov 27 04:43:30 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:43:30 user nova-compute[75260]:     <video>
Nov 27 04:43:30 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:43:30 user nova-compute[75260]:     </video>
Nov 27 04:43:30 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:43:30 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:43:30 user nova-compute[75260]:     </rng>
Nov 27 04:43:30 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:43:30 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:43:30 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:43:30 user nova-compute[75260]:     </memballoon>
Nov 27 04:43:30 user nova-compute[75260]:   </devices>
Nov 27 04:43:30 user nova-compute[75260]: </domain>
Nov 27 04:43:30 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:43:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Instance destroyed successfully.
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:43:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No VIF found with MAC fa:16:3e:a5:25:f7, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:43:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-4f61082e-234d-4c18-9baa-7c150d7ec53d req-dd45a6a0-88d2-43d8-8935-18ef37b79831 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4f61082e-234d-4c18-9baa-7c150d7ec53d req-dd45a6a0-88d2-43d8-8935-18ef37b79831 service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4f61082e-234d-4c18-9baa-7c150d7ec53d req-dd45a6a0-88d2-43d8-8935-18ef37b79831 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4f61082e-234d-4c18-9baa-7c150d7ec53d req-dd45a6a0-88d2-43d8-8935-18ef37b79831 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-4f61082e-234d-4c18-9baa-7c150d7ec53d req-dd45a6a0-88d2-43d8-8935-18ef37b79831 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:31 user nova-compute[75260]: WARNING nova.compute.manager [req-4f61082e-234d-4c18-9baa-7c150d7ec53d req-dd45a6a0-88d2-43d8-8935-18ef37b79831 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state active and task_state rescuing.
Nov 27 04:43:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:33 user nova-compute[75260]: DEBUG nova.compute.manager [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:33 user nova-compute[75260]: DEBUG nova.compute.manager [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:33 user nova-compute[75260]: WARNING nova.compute.manager [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state active and task_state rescuing.
Nov 27 04:43:33 user nova-compute[75260]: DEBUG nova.compute.manager [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:33 user nova-compute[75260]: DEBUG nova.compute.manager [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:33 user nova-compute[75260]: WARNING nova.compute.manager [req-559cf383-1092-4370-845c-c7a1f23f2bd1 req-cf45570c-e22d-420a-bb2e-8da4ed59b135 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state active and task_state rescuing.
Nov 27 04:43:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-806d2a25-127e-427f-9c91-924c7308be8d tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:43:35 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:43:35 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:43:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:37 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:43:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:38 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:43:38 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:43:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:38 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:43:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:43:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:43:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "d0364679-4db1-4da8-bce8-80eea41feb13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "d0364679-4db1-4da8-bce8-80eea41feb13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:43 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:43:43 user nova-compute[75260]: INFO nova.compute.claims [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Claim successful on node user
Nov 27 04:43:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:44 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:43:44 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7714MB free_disk=25.57564926147461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.010s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.389s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:43:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Applying migration context for instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90 as it has an incoming, in-progress migration 3108b385-0b0c-4385-a6f1-5197412862cf. Migration status is finished {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 04:43:44 user nova-compute[75260]: INFO nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating resource usage from migration 3108b385-0b0c-4385-a6f1-5197412862cf
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 12efb820-12ab-442d-a5fe-80b08f12a729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d47665e4-157a-46e2-85a3-1c5cde99db1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance cd971ad8-53b2-4088-9133-862ab89dc27e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance f29b0503-13ae-4efa-99cf-07b30dbfd2f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Migration 3108b385-0b0c-4385-a6f1-5197412862cf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 2e5dcd4e-21fc-461e-bd84-9d5feca96734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d0364679-4db1-4da8-bce8-80eea41feb13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:43:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Creating image(s)
Nov 27 04:43:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "/opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "/opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.027s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.policy [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f5e727696d94f35a7f111cfa01a2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fd7cc4144d4422a140157d994f8c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:45 user nova-compute[75260]: INFO nova.compute.manager [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Detaching volume 07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.226s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:45 user nova-compute[75260]: INFO nova.virt.block_device [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Attempting to driver detach volume 07546b0b-458c-407a-8ed3-b578c807d68d from mountpoint /dev/vdb
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Attempting to detach device vdb from instance d47665e4-157a-46e2-85a3-1c5cde99db1a from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:43:45 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:43:45 user nova-compute[75260]:   <source dev="/dev/sdj"/>
Nov 27 04:43:45 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:43:45 user nova-compute[75260]:   <serial>07546b0b-458c-407a-8ed3-b578c807d68d</serial>
Nov 27 04:43:45 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:43:45 user nova-compute[75260]: </disk>
Nov 27 04:43:45 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:43:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully detached device vdb from instance d47665e4-157a-46e2-85a3-1c5cde99db1a from the persistent domain config.
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d47665e4-157a-46e2-85a3-1c5cde99db1a from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:43:45 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:43:45 user nova-compute[75260]:   <source dev="/dev/sdj"/>
Nov 27 04:43:45 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:43:45 user nova-compute[75260]:   <serial>07546b0b-458c-407a-8ed3-b578c807d68d</serial>
Nov 27 04:43:45 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:43:45 user nova-compute[75260]: </disk>
Nov 27 04:43:45 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk 1073741824" returned: 0 in 0.114s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.906s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.237s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Successfully created port: 7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d47665e4-157a-46e2-85a3-1c5cde99db1a {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Cannot resize image /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Ensure instance console log exists: /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Successfully updated port: 7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "refresh_cache-d0364679-4db1-4da8-bce8-80eea41feb13" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquired lock "refresh_cache-d0364679-4db1-4da8-bce8-80eea41feb13" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-575065b9-66ef-4072-9fe9-01e212ca8cb6 req-08f7db7c-3c9e-4d82-ab49-fb2c8518d7e7 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Received event network-changed-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-575065b9-66ef-4072-9fe9-01e212ca8cb6 req-08f7db7c-3c9e-4d82-ab49-fb2c8518d7e7 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Refreshing instance network info cache due to event network-changed-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-575065b9-66ef-4072-9fe9-01e212ca8cb6 req-08f7db7c-3c9e-4d82-ab49-fb2c8518d7e7 service nova] Acquiring lock "refresh_cache-d0364679-4db1-4da8-bce8-80eea41feb13" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:43:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Updating instance_info_cache with network_info: [{"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Releasing lock "refresh_cache-d0364679-4db1-4da8-bce8-80eea41feb13" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Instance network_info: |[{"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-575065b9-66ef-4072-9fe9-01e212ca8cb6 req-08f7db7c-3c9e-4d82-ab49-fb2c8518d7e7 service nova] Acquired lock "refresh_cache-d0364679-4db1-4da8-bce8-80eea41feb13" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.network.neutron [req-575065b9-66ef-4072-9fe9-01e212ca8cb6 req-08f7db7c-3c9e-4d82-ab49-fb2c8518d7e7 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Refreshing network info cache for port 7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Start _get_guest_xml network_info=[{"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:43:47 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:43:47 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-98185851',display_name='tempest-ServersNegativeTestJSON-server-98185851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-98185851',id=16,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2fd7cc4144d4422a140157d994f8c06',ramdisk_id='',reservation_id='r-zl39l0w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1694781308',owner_user_name='tempest-ServersNegativeTestJSON-1694781308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:43:45Z,user_data=None,user_id='1f5e727696d94f35a7f111cfa01a2530',uuid=d0364679-4db1-4da8-bce8-80eea41feb13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converting VIF {"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:75:78,bridge_name='br-int',has_traffic_filtering=True,id=7b0f9e10-c1fa-4a44-9521-cc419eb2dab6,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0f9e10-c1') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lazy-loading 'pci_devices' on Instance uuid d0364679-4db1-4da8-bce8-80eea41feb13 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating instance_info_cache with network_info: [{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:43:47 user nova-compute[75260]:   <uuid>d0364679-4db1-4da8-bce8-80eea41feb13</uuid>
Nov 27 04:43:47 user nova-compute[75260]:   <name>instance-00000010</name>
Nov 27 04:43:47 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:43:47 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:43:47 user nova-compute[75260]:   <metadata>
Nov 27 04:43:47 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:43:47 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:43:47 user nova-compute[75260]:       <nova:name>tempest-ServersNegativeTestJSON-server-98185851</nova:name>
Nov 27 04:43:47 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:43:47</nova:creationTime>
Nov 27 04:43:47 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:43:47 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:43:47 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:43:47 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:43:47 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:43:47 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:43:47 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:43:47 user nova-compute[75260]:       <nova:owner>
Nov 27 04:43:47 user nova-compute[75260]:         <nova:user uuid="1f5e727696d94f35a7f111cfa01a2530">tempest-ServersNegativeTestJSON-1694781308-project-member</nova:user>
Nov 27 04:43:47 user nova-compute[75260]:         <nova:project uuid="d2fd7cc4144d4422a140157d994f8c06">tempest-ServersNegativeTestJSON-1694781308</nova:project>
Nov 27 04:43:47 user nova-compute[75260]:       </nova:owner>
Nov 27 04:43:47 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:43:47 user nova-compute[75260]:       <nova:ports>
Nov 27 04:43:47 user nova-compute[75260]:         <nova:port uuid="7b0f9e10-c1fa-4a44-9521-cc419eb2dab6">
Nov 27 04:43:47 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 04:43:47 user nova-compute[75260]:         </nova:port>
Nov 27 04:43:47 user nova-compute[75260]:       </nova:ports>
Nov 27 04:43:47 user nova-compute[75260]:     </nova:instance>
Nov 27 04:43:47 user nova-compute[75260]:   </metadata>
Nov 27 04:43:47 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:43:47 user nova-compute[75260]:     <system>
Nov 27 04:43:47 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:43:47 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:43:47 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:43:47 user nova-compute[75260]:       <entry name="serial">d0364679-4db1-4da8-bce8-80eea41feb13</entry>
Nov 27 04:43:47 user nova-compute[75260]:       <entry name="uuid">d0364679-4db1-4da8-bce8-80eea41feb13</entry>
Nov 27 04:43:47 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:43:47 user nova-compute[75260]:     </system>
Nov 27 04:43:47 user nova-compute[75260]:   </sysinfo>
Nov 27 04:43:47 user nova-compute[75260]:   <os>
Nov 27 04:43:47 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:43:47 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:43:47 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:43:47 user nova-compute[75260]:   </os>
Nov 27 04:43:47 user nova-compute[75260]:   <features>
Nov 27 04:43:47 user nova-compute[75260]:     <acpi/>
Nov 27 04:43:47 user nova-compute[75260]:     <apic/>
Nov 27 04:43:47 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:43:47 user nova-compute[75260]:   </features>
Nov 27 04:43:47 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:43:47 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:43:47 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:43:47 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:43:47 user nova-compute[75260]:   </clock>
Nov 27 04:43:47 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:43:47 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:43:47 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:43:47 user nova-compute[75260]:   </cpu>
Nov 27 04:43:47 user nova-compute[75260]:   <devices>
Nov 27 04:43:47 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:43:47 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:43:47 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk"/>
Nov 27 04:43:47 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:43:47 user nova-compute[75260]:     </disk>
Nov 27 04:43:47 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:43:47 user nova-compute[75260]:       <mac address="fa:16:3e:45:75:78"/>
Nov 27 04:43:47 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:43:47 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:43:47 user nova-compute[75260]:       <target dev="tap7b0f9e10-c1"/>
Nov 27 04:43:47 user nova-compute[75260]:     </interface>
Nov 27 04:43:47 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:43:47 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/console.log" append="off"/>
Nov 27 04:43:47 user nova-compute[75260]:     </serial>
Nov 27 04:43:47 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:43:47 user nova-compute[75260]:     <video>
Nov 27 04:43:47 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:43:47 user nova-compute[75260]:     </video>
Nov 27 04:43:47 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:43:47 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:43:47 user nova-compute[75260]:     </rng>
Nov 27 04:43:47 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:43:47 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:43:47 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:43:47 user nova-compute[75260]:     </memballoon>
Nov 27 04:43:47 user nova-compute[75260]:   </devices>
Nov 27 04:43:47 user nova-compute[75260]: </domain>
Nov 27 04:43:47 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-98185851',display_name='tempest-ServersNegativeTestJSON-server-98185851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-98185851',id=16,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2fd7cc4144d4422a140157d994f8c06',ramdisk_id='',reservation_id='r-zl39l0w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1694781308',owner_user_name='tempest-ServersNegativeTestJSON-1694781308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:43:45Z,user_data=None,user_id='1f5e727696d94f35a7f111cfa01a2530',uuid=d0364679-4db1-4da8-bce8-80eea41feb13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converting VIF {"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:75:78,bridge_name='br-int',has_traffic_filtering=True,id=7b0f9e10-c1fa-4a44-9521-cc419eb2dab6,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0f9e10-c1') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG os_vif [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:75:78,bridge_name='br-int',has_traffic_filtering=True,id=7b0f9e10-c1fa-4a44-9521-cc419eb2dab6,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0f9e10-c1') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10a67c98-e30b-5202-822a-dfc391d29f29', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b0f9e10-c1, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b0f9e10-c1, col_values=(('qos', UUID('8c1c5fb0-2031-4c62-a53b-41dc46bd62d1')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b0f9e10-c1, col_values=(('external_ids', {'iface-id': '7b0f9e10-c1fa-4a44-9521-cc419eb2dab6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:75:78', 'vm-uuid': 'd0364679-4db1-4da8-bce8-80eea41feb13'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:47 user nova-compute[75260]: INFO os_vif [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:75:78,bridge_name='br-int',has_traffic_filtering=True,id=7b0f9e10-c1fa-4a44-9521-cc419eb2dab6,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0f9e10-c1')
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] No VIF found with MAC fa:16:3e:45:75:78, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.network.neutron [req-575065b9-66ef-4072-9fe9-01e212ca8cb6 req-08f7db7c-3c9e-4d82-ab49-fb2c8518d7e7 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Updated VIF entry in instance network info cache for port 7b0f9e10-c1fa-4a44-9521-cc419eb2dab6. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG nova.network.neutron [req-575065b9-66ef-4072-9fe9-01e212ca8cb6 req-08f7db7c-3c9e-4d82-ab49-fb2c8518d7e7 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Updating instance_info_cache with network_info: [{"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:43:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-575065b9-66ef-4072-9fe9-01e212ca8cb6 req-08f7db7c-3c9e-4d82-ab49-fb2c8518d7e7 service nova] Releasing lock "refresh_cache-d0364679-4db1-4da8-bce8-80eea41feb13" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:43:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c1b24e9-43f3-4776-b8e7-e0b9a607a8d5 req-c59efaa0-e836-4d65-aeb1-0eee722ac5e7 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Received event network-vif-plugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c1b24e9-43f3-4776-b8e7-e0b9a607a8d5 req-c59efaa0-e836-4d65-aeb1-0eee722ac5e7 service nova] Acquiring lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c1b24e9-43f3-4776-b8e7-e0b9a607a8d5 req-c59efaa0-e836-4d65-aeb1-0eee722ac5e7 service nova] Lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c1b24e9-43f3-4776-b8e7-e0b9a607a8d5 req-c59efaa0-e836-4d65-aeb1-0eee722ac5e7 service nova] Lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c1b24e9-43f3-4776-b8e7-e0b9a607a8d5 req-c59efaa0-e836-4d65-aeb1-0eee722ac5e7 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] No waiting events found dispatching network-vif-plugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:49 user nova-compute[75260]: WARNING nova.compute.manager [req-4c1b24e9-43f3-4776-b8e7-e0b9a607a8d5 req-c59efaa0-e836-4d65-aeb1-0eee722ac5e7 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Received unexpected event network-vif-plugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 for instance with vm_state building and task_state spawning.
Nov 27 04:43:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:43:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Instance spawned successfully.
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-0548ce43-b01c-4557-9600-9df11f65ab47 req-17e712d3-69ae-4118-bd59-3780f9e0ffcc service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Received event network-vif-plugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0548ce43-b01c-4557-9600-9df11f65ab47 req-17e712d3-69ae-4118-bd59-3780f9e0ffcc service nova] Acquiring lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0548ce43-b01c-4557-9600-9df11f65ab47 req-17e712d3-69ae-4118-bd59-3780f9e0ffcc service nova] Lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0548ce43-b01c-4557-9600-9df11f65ab47 req-17e712d3-69ae-4118-bd59-3780f9e0ffcc service nova] Lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-0548ce43-b01c-4557-9600-9df11f65ab47 req-17e712d3-69ae-4118-bd59-3780f9e0ffcc service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] No waiting events found dispatching network-vif-plugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:51 user nova-compute[75260]: WARNING nova.compute.manager [req-0548ce43-b01c-4557-9600-9df11f65ab47 req-17e712d3-69ae-4118-bd59-3780f9e0ffcc service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Received unexpected event network-vif-plugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 for instance with vm_state building and task_state spawning.
Nov 27 04:43:51 user nova-compute[75260]: INFO nova.compute.manager [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 27 04:43:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:43:51 user nova-compute[75260]: INFO nova.compute.manager [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Took 7.75 seconds to build instance.
Nov 27 04:43:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3e45a22c-4c3c-4016-a7e0-bb596f8f0df2 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "d0364679-4db1-4da8-bce8-80eea41feb13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.957s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:54 user nova-compute[75260]: INFO nova.compute.manager [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Terminating instance
Nov 27 04:43:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:43:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-bfcf5dd5-a9ea-46e0-bd3f-d13fe4a70d3f req-92e1eb5f-5e6d-42ee-bc34-327dc645a2d8 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Received event network-vif-unplugged-d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bfcf5dd5-a9ea-46e0-bd3f-d13fe4a70d3f req-92e1eb5f-5e6d-42ee-bc34-327dc645a2d8 service nova] Acquiring lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bfcf5dd5-a9ea-46e0-bd3f-d13fe4a70d3f req-92e1eb5f-5e6d-42ee-bc34-327dc645a2d8 service nova] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bfcf5dd5-a9ea-46e0-bd3f-d13fe4a70d3f req-92e1eb5f-5e6d-42ee-bc34-327dc645a2d8 service nova] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-bfcf5dd5-a9ea-46e0-bd3f-d13fe4a70d3f req-92e1eb5f-5e6d-42ee-bc34-327dc645a2d8 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] No waiting events found dispatching network-vif-unplugged-d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-bfcf5dd5-a9ea-46e0-bd3f-d13fe4a70d3f req-92e1eb5f-5e6d-42ee-bc34-327dc645a2d8 service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Received event network-vif-unplugged-d84fa805-1b5d-40a7-8db2-782121d7d54e for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Instance destroyed successfully.
Nov 27 04:43:55 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lazy-loading 'resources' on Instance uuid f29b0503-13ae-4efa-99cf-07b30dbfd2f3 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1525752170',display_name='tempest-VolumesAdminNegativeTest-server-1525752170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1525752170',id=14,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:42:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='deff7f2657d442a89aa29b3de5e9680c',ramdisk_id='',reservation_id='r-r9w4enid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-494319220',owner_user_name='tempest-VolumesAdminNegativeTest-494319220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:42:04Z,user_data=None,user_id='87cf690bdffe48d39b62bf09cca81d90',uuid=f29b0503-13ae-4efa-99cf-07b30dbfd2f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "address": "fa:16:3e:f0:a7:a6", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd84fa805-1b", "ovs_interfaceid": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converting VIF {"id": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "address": "fa:16:3e:f0:a7:a6", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd84fa805-1b", "ovs_interfaceid": "d84fa805-1b5d-40a7-8db2-782121d7d54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=d84fa805-1b5d-40a7-8db2-782121d7d54e,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd84fa805-1b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG os_vif [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=d84fa805-1b5d-40a7-8db2-782121d7d54e,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd84fa805-1b') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd84fa805-1b, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eef73c7d-4da6-44f7-bc48-64bbce6a27d8) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:43:55 user nova-compute[75260]: INFO os_vif [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a7:a6,bridge_name='br-int',has_traffic_filtering=True,id=d84fa805-1b5d-40a7-8db2-782121d7d54e,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd84fa805-1b')
Nov 27 04:43:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Deleting instance files /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3_del
Nov 27 04:43:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Deletion of /opt/stack/data/nova/instances/f29b0503-13ae-4efa-99cf-07b30dbfd2f3_del complete
Nov 27 04:43:55 user nova-compute[75260]: INFO nova.compute.manager [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 27 04:43:55 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:43:55 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:43:56 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:43:56 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Took 0.78 seconds to deallocate network for instance.
Nov 27 04:43:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-902bd30a-300f-4516-92ac-5edd860c94f0 req-3264ba0e-5067-47d5-ae45-0369de4c613f service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Received event network-vif-deleted-d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:56 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:43:56 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:43:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:57 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Deleted allocations for instance f29b0503-13ae-4efa-99cf-07b30dbfd2f3
Nov 27 04:43:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3c46624b-17c8-4b6f-a11b-4078dc09afbe tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.511s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-58afc64e-91ad-4050-8f69-2933486bcbaa req-e6f9ad7c-f914-45ef-9aa1-e7b9dbd8de4c service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Received event network-vif-plugged-d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:43:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-58afc64e-91ad-4050-8f69-2933486bcbaa req-e6f9ad7c-f914-45ef-9aa1-e7b9dbd8de4c service nova] Acquiring lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-58afc64e-91ad-4050-8f69-2933486bcbaa req-e6f9ad7c-f914-45ef-9aa1-e7b9dbd8de4c service nova] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-58afc64e-91ad-4050-8f69-2933486bcbaa req-e6f9ad7c-f914-45ef-9aa1-e7b9dbd8de4c service nova] Lock "f29b0503-13ae-4efa-99cf-07b30dbfd2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:43:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-58afc64e-91ad-4050-8f69-2933486bcbaa req-e6f9ad7c-f914-45ef-9aa1-e7b9dbd8de4c service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] No waiting events found dispatching network-vif-plugged-d84fa805-1b5d-40a7-8db2-782121d7d54e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:43:57 user nova-compute[75260]: WARNING nova.compute.manager [req-58afc64e-91ad-4050-8f69-2933486bcbaa req-e6f9ad7c-f914-45ef-9aa1-e7b9dbd8de4c service nova] [instance: f29b0503-13ae-4efa-99cf-07b30dbfd2f3] Received unexpected event network-vif-plugged-d84fa805-1b5d-40a7-8db2-782121d7d54e for instance with vm_state deleted and task_state None.
Nov 27 04:43:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:43:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Acquiring lock "11e38841-7318-43cf-9274-4f8a7343c76f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "11e38841-7318-43cf-9274-4f8a7343c76f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:43:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:43:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:43:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:43:59 user nova-compute[75260]: INFO nova.compute.claims [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Claim successful on node user
Nov 27 04:44:00 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:44:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:44:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:44:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Creating image(s)
Nov 27 04:44:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Acquiring lock "/opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "/opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "/opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG nova.policy [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14516d1255c8413a804939fcc6d88735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf60fe2979a464b9373bbcb002cf84d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk 1073741824" returned: 0 in 0.051s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.200s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Cannot resize image /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Ensure instance console log exists: /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:01 user nova-compute[75260]: DEBUG nova.network.neutron [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Successfully created port: a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Successfully updated port: a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Acquiring lock "refresh_cache-11e38841-7318-43cf-9274-4f8a7343c76f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Acquired lock "refresh_cache-11e38841-7318-43cf-9274-4f8a7343c76f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-f58ff960-808f-489e-b05c-ce002737dc83 req-8bc80800-3ddc-43e5-9ba4-0c986bc562bf service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Received event network-changed-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-f58ff960-808f-489e-b05c-ce002737dc83 req-8bc80800-3ddc-43e5-9ba4-0c986bc562bf service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Refreshing instance network info cache due to event network-changed-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f58ff960-808f-489e-b05c-ce002737dc83 req-8bc80800-3ddc-43e5-9ba4-0c986bc562bf service nova] Acquiring lock "refresh_cache-11e38841-7318-43cf-9274-4f8a7343c76f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Updating instance_info_cache with network_info: [{"id": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "address": "fa:16:3e:d2:16:fe", "network": {"id": "11791783-1ddf-472a-8d2f-d4914c1cf3e6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e2eec6901a284b46afc99dbeefbc586f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1842c9a-f6", "ovs_interfaceid": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Releasing lock "refresh_cache-11e38841-7318-43cf-9274-4f8a7343c76f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Instance network_info: |[{"id": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "address": "fa:16:3e:d2:16:fe", "network": {"id": "11791783-1ddf-472a-8d2f-d4914c1cf3e6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e2eec6901a284b46afc99dbeefbc586f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1842c9a-f6", "ovs_interfaceid": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f58ff960-808f-489e-b05c-ce002737dc83 req-8bc80800-3ddc-43e5-9ba4-0c986bc562bf service nova] Acquired lock "refresh_cache-11e38841-7318-43cf-9274-4f8a7343c76f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG nova.network.neutron [req-f58ff960-808f-489e-b05c-ce002737dc83 req-8bc80800-3ddc-43e5-9ba4-0c986bc562bf service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Refreshing network info cache for port a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:44:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Start _get_guest_xml network_info=[{"id": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "address": "fa:16:3e:d2:16:fe", "network": {"id": "11791783-1ddf-472a-8d2f-d4914c1cf3e6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e2eec6901a284b46afc99dbeefbc586f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1842c9a-f6", "ovs_interfaceid": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:44:02 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:02 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1122825738',display_name='tempest-VolumesNegativeTest-instance-1122825738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1122825738',id=17,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf60fe2979a464b9373bbcb002cf84d',ramdisk_id='',reservation_id='r-0i9wfuof',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1570116772',owner_user_name='tempest-VolumesNegativeTest-1570116772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:44:01Z,user_data=None,user_id='14516d1255c8413a804939fcc6d88735',uuid=11e38841-7318-43cf-9274-4f8a7343c76f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "address": "fa:16:3e:d2:16:fe", "network": {"id": "11791783-1ddf-472a-8d2f-d4914c1cf3e6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e2eec6901a284b46afc99dbeefbc586f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1842c9a-f6", "ovs_interfaceid": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Converting VIF {"id": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "address": "fa:16:3e:d2:16:fe", "network": {"id": "11791783-1ddf-472a-8d2f-d4914c1cf3e6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e2eec6901a284b46afc99dbeefbc586f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1842c9a-f6", "ovs_interfaceid": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1842c9a-f6c1-4a31-aa72-5cebe1c68b30,network=Network(11791783-1ddf-472a-8d2f-d4914c1cf3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1842c9a-f6') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.objects.instance [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lazy-loading 'pci_devices' on Instance uuid 11e38841-7318-43cf-9274-4f8a7343c76f {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:44:03 user nova-compute[75260]:   <uuid>11e38841-7318-43cf-9274-4f8a7343c76f</uuid>
Nov 27 04:44:03 user nova-compute[75260]:   <name>instance-00000011</name>
Nov 27 04:44:03 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:44:03 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:44:03 user nova-compute[75260]:   <metadata>
Nov 27 04:44:03 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:44:03 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:44:03 user nova-compute[75260]:       <nova:name>tempest-VolumesNegativeTest-instance-1122825738</nova:name>
Nov 27 04:44:03 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:44:02</nova:creationTime>
Nov 27 04:44:03 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:44:03 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:44:03 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:44:03 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:44:03 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:44:03 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:44:03 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:44:03 user nova-compute[75260]:       <nova:owner>
Nov 27 04:44:03 user nova-compute[75260]:         <nova:user uuid="14516d1255c8413a804939fcc6d88735">tempest-VolumesNegativeTest-1570116772-project-member</nova:user>
Nov 27 04:44:03 user nova-compute[75260]:         <nova:project uuid="1bf60fe2979a464b9373bbcb002cf84d">tempest-VolumesNegativeTest-1570116772</nova:project>
Nov 27 04:44:03 user nova-compute[75260]:       </nova:owner>
Nov 27 04:44:03 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:44:03 user nova-compute[75260]:       <nova:ports>
Nov 27 04:44:03 user nova-compute[75260]:         <nova:port uuid="a1842c9a-f6c1-4a31-aa72-5cebe1c68b30">
Nov 27 04:44:03 user nova-compute[75260]:           <nova:ip type="fixed" address="192.168.233.251" ipVersion="4"/>
Nov 27 04:44:03 user nova-compute[75260]:         </nova:port>
Nov 27 04:44:03 user nova-compute[75260]:       </nova:ports>
Nov 27 04:44:03 user nova-compute[75260]:     </nova:instance>
Nov 27 04:44:03 user nova-compute[75260]:   </metadata>
Nov 27 04:44:03 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:44:03 user nova-compute[75260]:     <system>
Nov 27 04:44:03 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:44:03 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:44:03 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:44:03 user nova-compute[75260]:       <entry name="serial">11e38841-7318-43cf-9274-4f8a7343c76f</entry>
Nov 27 04:44:03 user nova-compute[75260]:       <entry name="uuid">11e38841-7318-43cf-9274-4f8a7343c76f</entry>
Nov 27 04:44:03 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:44:03 user nova-compute[75260]:     </system>
Nov 27 04:44:03 user nova-compute[75260]:   </sysinfo>
Nov 27 04:44:03 user nova-compute[75260]:   <os>
Nov 27 04:44:03 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:44:03 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:44:03 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:44:03 user nova-compute[75260]:   </os>
Nov 27 04:44:03 user nova-compute[75260]:   <features>
Nov 27 04:44:03 user nova-compute[75260]:     <acpi/>
Nov 27 04:44:03 user nova-compute[75260]:     <apic/>
Nov 27 04:44:03 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:44:03 user nova-compute[75260]:   </features>
Nov 27 04:44:03 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:44:03 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:44:03 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:44:03 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:44:03 user nova-compute[75260]:   </clock>
Nov 27 04:44:03 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:44:03 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:44:03 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:44:03 user nova-compute[75260]:   </cpu>
Nov 27 04:44:03 user nova-compute[75260]:   <devices>
Nov 27 04:44:03 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:44:03 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:44:03 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk"/>
Nov 27 04:44:03 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:44:03 user nova-compute[75260]:     </disk>
Nov 27 04:44:03 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:44:03 user nova-compute[75260]:       <mac address="fa:16:3e:d2:16:fe"/>
Nov 27 04:44:03 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:44:03 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:44:03 user nova-compute[75260]:       <target dev="tapa1842c9a-f6"/>
Nov 27 04:44:03 user nova-compute[75260]:     </interface>
Nov 27 04:44:03 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:44:03 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/console.log" append="off"/>
Nov 27 04:44:03 user nova-compute[75260]:     </serial>
Nov 27 04:44:03 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:44:03 user nova-compute[75260]:     <video>
Nov 27 04:44:03 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:44:03 user nova-compute[75260]:     </video>
Nov 27 04:44:03 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:44:03 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:44:03 user nova-compute[75260]:     </rng>
Nov 27 04:44:03 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:44:03 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:44:03 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:44:03 user nova-compute[75260]:     </memballoon>
Nov 27 04:44:03 user nova-compute[75260]:   </devices>
Nov 27 04:44:03 user nova-compute[75260]: </domain>
Nov 27 04:44:03 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1122825738',display_name='tempest-VolumesNegativeTest-instance-1122825738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1122825738',id=17,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf60fe2979a464b9373bbcb002cf84d',ramdisk_id='',reservation_id='r-0i9wfuof',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1570116772',owner_user_name='tempest-VolumesNegativeTest-1570116772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:44:01Z,user_data=None,user_id='14516d1255c8413a804939fcc6d88735',uuid=11e38841-7318-43cf-9274-4f8a7343c76f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "address": "fa:16:3e:d2:16:fe", "network": {"id": "11791783-1ddf-472a-8d2f-d4914c1cf3e6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e2eec6901a284b46afc99dbeefbc586f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1842c9a-f6", "ovs_interfaceid": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Converting VIF {"id": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "address": "fa:16:3e:d2:16:fe", "network": {"id": "11791783-1ddf-472a-8d2f-d4914c1cf3e6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e2eec6901a284b46afc99dbeefbc586f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1842c9a-f6", "ovs_interfaceid": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1842c9a-f6c1-4a31-aa72-5cebe1c68b30,network=Network(11791783-1ddf-472a-8d2f-d4914c1cf3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1842c9a-f6') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG os_vif [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1842c9a-f6c1-4a31-aa72-5cebe1c68b30,network=Network(11791783-1ddf-472a-8d2f-d4914c1cf3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1842c9a-f6') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5712bc88-c9a7-5252-819d-559ba1f77a11', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1842c9a-f6, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1842c9a-f6, col_values=(('qos', UUID('ee706bc2-5bd2-4af7-9b51-f0d29d989e9c')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1842c9a-f6, col_values=(('external_ids', {'iface-id': 'a1842c9a-f6c1-4a31-aa72-5cebe1c68b30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:16:fe', 'vm-uuid': '11e38841-7318-43cf-9274-4f8a7343c76f'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:03 user nova-compute[75260]: INFO os_vif [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1842c9a-f6c1-4a31-aa72-5cebe1c68b30,network=Network(11791783-1ddf-472a-8d2f-d4914c1cf3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1842c9a-f6')
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] No VIF found with MAC fa:16:3e:d2:16:fe, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.network.neutron [req-f58ff960-808f-489e-b05c-ce002737dc83 req-8bc80800-3ddc-43e5-9ba4-0c986bc562bf service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Updated VIF entry in instance network info cache for port a1842c9a-f6c1-4a31-aa72-5cebe1c68b30. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG nova.network.neutron [req-f58ff960-808f-489e-b05c-ce002737dc83 req-8bc80800-3ddc-43e5-9ba4-0c986bc562bf service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Updating instance_info_cache with network_info: [{"id": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "address": "fa:16:3e:d2:16:fe", "network": {"id": "11791783-1ddf-472a-8d2f-d4914c1cf3e6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e2eec6901a284b46afc99dbeefbc586f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1842c9a-f6", "ovs_interfaceid": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f58ff960-808f-489e-b05c-ce002737dc83 req-8bc80800-3ddc-43e5-9ba4-0c986bc562bf service nova] Releasing lock "refresh_cache-11e38841-7318-43cf-9274-4f8a7343c76f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG nova.compute.manager [req-fd04c598-ac9c-4cc1-a40e-40528aef7940 req-3deae90b-8491-43cf-b5cc-ffac93e10940 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Received event network-vif-plugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fd04c598-ac9c-4cc1-a40e-40528aef7940 req-3deae90b-8491-43cf-b5cc-ffac93e10940 service nova] Acquiring lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fd04c598-ac9c-4cc1-a40e-40528aef7940 req-3deae90b-8491-43cf-b5cc-ffac93e10940 service nova] Lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fd04c598-ac9c-4cc1-a40e-40528aef7940 req-3deae90b-8491-43cf-b5cc-ffac93e10940 service nova] Lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG nova.compute.manager [req-fd04c598-ac9c-4cc1-a40e-40528aef7940 req-3deae90b-8491-43cf-b5cc-ffac93e10940 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] No waiting events found dispatching network-vif-plugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:05 user nova-compute[75260]: WARNING nova.compute.manager [req-fd04c598-ac9c-4cc1-a40e-40528aef7940 req-3deae90b-8491-43cf-b5cc-ffac93e10940 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Received unexpected event network-vif-plugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 for instance with vm_state building and task_state spawning.
Nov 27 04:44:05 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d47665e4-157a-46e2-85a3-1c5cde99db1a is timed out.
Nov 27 04:44:05 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully detached device vdb from instance d47665e4-157a-46e2-85a3-1c5cde99db1a from the live domain config.
Nov 27 04:44:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qxdNwmQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:44:05 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:44:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.080s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a413446-6e49-4d6e-880a-5f85c05eef05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:44:05 user nova-compute[75260]: No targets found.
Nov 27 04:44:05 user nova-compute[75260]: iSNS:
Nov 27 04:44:05 user nova-compute[75260]: No targets found.
Nov 27 04:44:05 user nova-compute[75260]: STATIC:
Nov 27 04:44:05 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:44:05 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:44:05 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:44:05 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d
Nov 27 04:44:05 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:44:05 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:44:05 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f
Nov 27 04:44:05 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:44:05 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:44:05 user nova-compute[75260]: FIRMWARE:
Nov 27 04:44:05 user nova-compute[75260]: No targets found.
Nov 27 04:44:05 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:44:05 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:44:05 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:44:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e881acf7-b767-4b26-a1e6-7fc95fedf25c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c704154-9805-45d7-bb62-d1bcfe1cfa77]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:44:06 user nova-compute[75260]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:44:06 user nova-compute[75260]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:44:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d (non-flash)
Nov 27 04:44:06 user nova-compute[75260]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:44:06 user nova-compute[75260]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:44:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb542adc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d'): ({'sdj'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Removing single pathed devices sdj {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4107f3-3599-4427-8709-90f2a8f5e908]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1cf504-18bf-47a3-8be1-eea640fa9d04]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flushing IO for device /dev/sdj {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aebea8-6b2d-4b17-a52d-4d9c199be47a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.048s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d678ef-54ff-429d-9a93-3766e07febde]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] SCSI volumes sdj have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[60005ae3-f5e0-43bf-8d0b-0869e7c90f4e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5888f36c-508f-4cf8-9763-77d82647e177]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d, portal: 172.16.0.220,3260]
Nov 27 04:44:06 user nova-compute[75260]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d, portal: 172.16.0.220,3260] successful.
Nov 27 04:44:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07546b0b-458c-407a-8ed3-b578c807d68d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[94da5f69-47db-48b7-ac6c-52a5eaa815ca]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.532s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] <== disconnect_volume: return (534ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:44:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:44:07 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Instance spawned successfully.
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:07 user nova-compute[75260]: INFO nova.compute.manager [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:44:07 user nova-compute[75260]: INFO nova.compute.manager [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Took 7.76 seconds to build instance.
Nov 27 04:44:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96b74213-5fd6-400b-aacf-259d610a64f0 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "11e38841-7318-43cf-9274-4f8a7343c76f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.934s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.objects.instance [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'flavor' on Instance uuid d47665e4-157a-46e2-85a3-1c5cde99db1a {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6e5fc52c-7a4c-40b2-baa5-b76aa5d3fbe0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.266s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-efed3c19-9813-4829-ba6b-cd006eacddc0 req-dcba46d2-bb4a-4d19-88f9-d1213d1e2244 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Received event network-vif-plugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-efed3c19-9813-4829-ba6b-cd006eacddc0 req-dcba46d2-bb4a-4d19-88f9-d1213d1e2244 service nova] Acquiring lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-efed3c19-9813-4829-ba6b-cd006eacddc0 req-dcba46d2-bb4a-4d19-88f9-d1213d1e2244 service nova] Lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-efed3c19-9813-4829-ba6b-cd006eacddc0 req-dcba46d2-bb4a-4d19-88f9-d1213d1e2244 service nova] Lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-efed3c19-9813-4829-ba6b-cd006eacddc0 req-dcba46d2-bb4a-4d19-88f9-d1213d1e2244 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] No waiting events found dispatching network-vif-plugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:07 user nova-compute[75260]: WARNING nova.compute.manager [req-efed3c19-9813-4829-ba6b-cd006eacddc0 req-dcba46d2-bb4a-4d19-88f9-d1213d1e2244 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Received unexpected event network-vif-plugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 for instance with vm_state active and task_state None.
Nov 27 04:44:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:22 user nova-compute[75260]: DEBUG nova.compute.manager [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:44:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:44:22 user nova-compute[75260]: INFO nova.compute.claims [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Claim successful on node user
Nov 27 04:44:23 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG nova.compute.manager [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG nova.compute.manager [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG nova.network.neutron [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:44:23 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:44:23 user nova-compute[75260]: DEBUG nova.compute.manager [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG nova.compute.manager [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:44:23 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Creating image(s)
Nov 27 04:44:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG nova.policy [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a463d6bb05e471c9dfaf686d06202e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d9acefde97437abee0beaae079fcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.235s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.227s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk 1073741824" returned: 0 in 0.077s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.200s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG nova.network.neutron [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Successfully created port: 376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Cannot resize image /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Ensure instance console log exists: /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.network.neutron [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Successfully updated port: 376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquired lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.network.neutron [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-3b4437a7-5cda-4025-884a-bef2e4fdbf1d req-0ce769c2-d7ac-4595-95a8-1792eed90881 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-changed-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-3b4437a7-5cda-4025-884a-bef2e4fdbf1d req-0ce769c2-d7ac-4595-95a8-1792eed90881 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Refreshing instance network info cache due to event network-changed-376192b1-f789-4b6f-be27-55efeb202f27. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3b4437a7-5cda-4025-884a-bef2e4fdbf1d req-0ce769c2-d7ac-4595-95a8-1792eed90881 service nova] Acquiring lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.network.neutron [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.network.neutron [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updating instance_info_cache with network_info: [{"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Releasing lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Instance network_info: |[{"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3b4437a7-5cda-4025-884a-bef2e4fdbf1d req-0ce769c2-d7ac-4595-95a8-1792eed90881 service nova] Acquired lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.network.neutron [req-3b4437a7-5cda-4025-884a-bef2e4fdbf1d req-0ce769c2-d7ac-4595-95a8-1792eed90881 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Refreshing network info cache for port 376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Start _get_guest_xml network_info=[{"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:44:25 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:25 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:44:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717557176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717557176',id=18,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW/qZPhLS1C8EQqzaoylt+DfXolIsqNuC0floaWTwm9Y8Kc2f0NOU/7QWq7h0reHBPBKp0h7iYnCXj4HbSmbHm1/Ah0OwOQu0068/YZcZc3v7umKCkKAxw0WIQGACGtqg==',key_name='tempest-keypair-875505160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3d9acefde97437abee0beaae079fcd9',ramdisk_id='',reservation_id='r-sco77w29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-682424273',owner_user_name='tempest-TaggedAttachmentsTest-682424273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a463d6bb05e471c9dfaf686d06202e1',uuid=1100294c-ea5b-4994-885d-47357e7802c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converting VIF {"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:d6:58,bridge_name='br-int',has_traffic_filtering=True,id=376192b1-f789-4b6f-be27-55efeb202f27,network=Network(a5d65a18-0b74-4a7d-931a-ad06304caa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376192b1-f7') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.objects.instance [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lazy-loading 'pci_devices' on Instance uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:44:26 user nova-compute[75260]:   <uuid>1100294c-ea5b-4994-885d-47357e7802c5</uuid>
Nov 27 04:44:26 user nova-compute[75260]:   <name>instance-00000012</name>
Nov 27 04:44:26 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:44:26 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:44:26 user nova-compute[75260]:   <metadata>
Nov 27 04:44:26 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:44:26 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:44:26 user nova-compute[75260]:       <nova:name>tempest-device-tagging-server-717557176</nova:name>
Nov 27 04:44:26 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:44:25</nova:creationTime>
Nov 27 04:44:26 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:44:26 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:44:26 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:44:26 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:44:26 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:44:26 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:44:26 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:44:26 user nova-compute[75260]:       <nova:owner>
Nov 27 04:44:26 user nova-compute[75260]:         <nova:user uuid="8a463d6bb05e471c9dfaf686d06202e1">tempest-TaggedAttachmentsTest-682424273-project-member</nova:user>
Nov 27 04:44:26 user nova-compute[75260]:         <nova:project uuid="a3d9acefde97437abee0beaae079fcd9">tempest-TaggedAttachmentsTest-682424273</nova:project>
Nov 27 04:44:26 user nova-compute[75260]:       </nova:owner>
Nov 27 04:44:26 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:44:26 user nova-compute[75260]:       <nova:ports>
Nov 27 04:44:26 user nova-compute[75260]:         <nova:port uuid="376192b1-f789-4b6f-be27-55efeb202f27">
Nov 27 04:44:26 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:44:26 user nova-compute[75260]:         </nova:port>
Nov 27 04:44:26 user nova-compute[75260]:       </nova:ports>
Nov 27 04:44:26 user nova-compute[75260]:     </nova:instance>
Nov 27 04:44:26 user nova-compute[75260]:   </metadata>
Nov 27 04:44:26 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:44:26 user nova-compute[75260]:     <system>
Nov 27 04:44:26 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:44:26 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:44:26 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:44:26 user nova-compute[75260]:       <entry name="serial">1100294c-ea5b-4994-885d-47357e7802c5</entry>
Nov 27 04:44:26 user nova-compute[75260]:       <entry name="uuid">1100294c-ea5b-4994-885d-47357e7802c5</entry>
Nov 27 04:44:26 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:44:26 user nova-compute[75260]:     </system>
Nov 27 04:44:26 user nova-compute[75260]:   </sysinfo>
Nov 27 04:44:26 user nova-compute[75260]:   <os>
Nov 27 04:44:26 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:44:26 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:44:26 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:44:26 user nova-compute[75260]:   </os>
Nov 27 04:44:26 user nova-compute[75260]:   <features>
Nov 27 04:44:26 user nova-compute[75260]:     <acpi/>
Nov 27 04:44:26 user nova-compute[75260]:     <apic/>
Nov 27 04:44:26 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:44:26 user nova-compute[75260]:   </features>
Nov 27 04:44:26 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:44:26 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:44:26 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:44:26 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:44:26 user nova-compute[75260]:   </clock>
Nov 27 04:44:26 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:44:26 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:44:26 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:44:26 user nova-compute[75260]:   </cpu>
Nov 27 04:44:26 user nova-compute[75260]:   <devices>
Nov 27 04:44:26 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:44:26 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:44:26 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk"/>
Nov 27 04:44:26 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:44:26 user nova-compute[75260]:     </disk>
Nov 27 04:44:26 user nova-compute[75260]:     <disk type="file" device="cdrom">
Nov 27 04:44:26 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 04:44:26 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.config"/>
Nov 27 04:44:26 user nova-compute[75260]:       <target dev="hda" bus="ide"/>
Nov 27 04:44:26 user nova-compute[75260]:     </disk>
Nov 27 04:44:26 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:44:26 user nova-compute[75260]:       <mac address="fa:16:3e:81:d6:58"/>
Nov 27 04:44:26 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:44:26 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:44:26 user nova-compute[75260]:       <target dev="tap376192b1-f7"/>
Nov 27 04:44:26 user nova-compute[75260]:     </interface>
Nov 27 04:44:26 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:44:26 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/console.log" append="off"/>
Nov 27 04:44:26 user nova-compute[75260]:     </serial>
Nov 27 04:44:26 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:44:26 user nova-compute[75260]:     <video>
Nov 27 04:44:26 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:44:26 user nova-compute[75260]:     </video>
Nov 27 04:44:26 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:44:26 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:44:26 user nova-compute[75260]:     </rng>
Nov 27 04:44:26 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:44:26 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:44:26 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:44:26 user nova-compute[75260]:     </memballoon>
Nov 27 04:44:26 user nova-compute[75260]:   </devices>
Nov 27 04:44:26 user nova-compute[75260]: </domain>
Nov 27 04:44:26 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717557176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717557176',id=18,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW/qZPhLS1C8EQqzaoylt+DfXolIsqNuC0floaWTwm9Y8Kc2f0NOU/7QWq7h0reHBPBKp0h7iYnCXj4HbSmbHm1/Ah0OwOQu0068/YZcZc3v7umKCkKAxw0WIQGACGtqg==',key_name='tempest-keypair-875505160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3d9acefde97437abee0beaae079fcd9',ramdisk_id='',reservation_id='r-sco77w29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-682424273',owner_user_name='tempest-TaggedAttachmentsTest-682424273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a463d6bb05e471c9dfaf686d06202e1',uuid=1100294c-ea5b-4994-885d-47357e7802c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converting VIF {"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:d6:58,bridge_name='br-int',has_traffic_filtering=True,id=376192b1-f789-4b6f-be27-55efeb202f27,network=Network(a5d65a18-0b74-4a7d-931a-ad06304caa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376192b1-f7') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG os_vif [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:d6:58,bridge_name='br-int',has_traffic_filtering=True,id=376192b1-f789-4b6f-be27-55efeb202f27,network=Network(a5d65a18-0b74-4a7d-931a-ad06304caa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376192b1-f7') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40bc0e8c-74b4-5c5c-b154-b626d153de3f', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap376192b1-f7, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap376192b1-f7, col_values=(('qos', UUID('858f136e-c8cd-444c-aa2c-d61ff242d2d4')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap376192b1-f7, col_values=(('external_ids', {'iface-id': '376192b1-f789-4b6f-be27-55efeb202f27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:d6:58', 'vm-uuid': '1100294c-ea5b-4994-885d-47357e7802c5'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:26 user nova-compute[75260]: INFO os_vif [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:d6:58,bridge_name='br-int',has_traffic_filtering=True,id=376192b1-f789-4b6f-be27-55efeb202f27,network=Network(a5d65a18-0b74-4a7d-931a-ad06304caa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376192b1-f7')
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] No BDM found with device name hda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] No VIF found with MAC fa:16:3e:81:d6:58, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:44:26 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Using config drive
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.network.neutron [req-3b4437a7-5cda-4025-884a-bef2e4fdbf1d req-0ce769c2-d7ac-4595-95a8-1792eed90881 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updated VIF entry in instance network info cache for port 376192b1-f789-4b6f-be27-55efeb202f27. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG nova.network.neutron [req-3b4437a7-5cda-4025-884a-bef2e4fdbf1d req-0ce769c2-d7ac-4595-95a8-1792eed90881 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updating instance_info_cache with network_info: [{"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3b4437a7-5cda-4025-884a-bef2e4fdbf1d req-0ce769c2-d7ac-4595-95a8-1792eed90881 service nova] Releasing lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:26 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Creating config drive at /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.config
Nov 27 04:44:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3bztohtj {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3bztohtj" returned: 0 in 0.072s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-f849cafc-9c7b-47b6-b921-68f052e5104b req-411e9d11-4c08-4212-8efd-0c69b72fabc7 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-plugged-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f849cafc-9c7b-47b6-b921-68f052e5104b req-411e9d11-4c08-4212-8efd-0c69b72fabc7 service nova] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f849cafc-9c7b-47b6-b921-68f052e5104b req-411e9d11-4c08-4212-8efd-0c69b72fabc7 service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f849cafc-9c7b-47b6-b921-68f052e5104b req-411e9d11-4c08-4212-8efd-0c69b72fabc7 service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-f849cafc-9c7b-47b6-b921-68f052e5104b req-411e9d11-4c08-4212-8efd-0c69b72fabc7 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] No waiting events found dispatching network-vif-plugged-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:28 user nova-compute[75260]: WARNING nova.compute.manager [req-f849cafc-9c7b-47b6-b921-68f052e5104b req-411e9d11-4c08-4212-8efd-0c69b72fabc7 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received unexpected event network-vif-plugged-376192b1-f789-4b6f-be27-55efeb202f27 for instance with vm_state building and task_state spawning.
Nov 27 04:44:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Acquiring lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:44:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:29 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:44:29 user nova-compute[75260]: INFO nova.compute.claims [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Claim successful on node user
Nov 27 04:44:29 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:44:29 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:44:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:44:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.policy [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfdea97aebe645018321c9c7ca211c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97394fe74bf6412fbc561c1f7dad4af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-17477d28-93d8-4f07-a042-c2ffa5e512d6 req-71ad0ebf-8fbc-48dc-94ca-824b9fa6c596 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-plugged-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-17477d28-93d8-4f07-a042-c2ffa5e512d6 req-71ad0ebf-8fbc-48dc-94ca-824b9fa6c596 service nova] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-17477d28-93d8-4f07-a042-c2ffa5e512d6 req-71ad0ebf-8fbc-48dc-94ca-824b9fa6c596 service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-17477d28-93d8-4f07-a042-c2ffa5e512d6 req-71ad0ebf-8fbc-48dc-94ca-824b9fa6c596 service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-17477d28-93d8-4f07-a042-c2ffa5e512d6 req-71ad0ebf-8fbc-48dc-94ca-824b9fa6c596 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] No waiting events found dispatching network-vif-plugged-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:30 user nova-compute[75260]: WARNING nova.compute.manager [req-17477d28-93d8-4f07-a042-c2ffa5e512d6 req-71ad0ebf-8fbc-48dc-94ca-824b9fa6c596 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received unexpected event network-vif-plugged-376192b1-f789-4b6f-be27-55efeb202f27 for instance with vm_state building and task_state spawning.
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:44:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Creating image(s)
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Acquiring lock "/opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "/opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "/opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:44:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Instance spawned successfully.
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:30 user nova-compute[75260]: INFO nova.compute.manager [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Took 6.82 seconds to spawn the instance on the hypervisor.
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:30 user nova-compute[75260]: INFO nova.compute.manager [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Took 7.88 seconds to build instance.
Nov 27 04:44:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-33fa2e53-723b-4cb2-b57f-052eae7e1709 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.034s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk 1073741824" returned: 0 in 0.051s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:30 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Successfully created port: 67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Cannot resize image /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Ensure instance console log exists: /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Successfully updated port: 67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Acquiring lock "refresh_cache-a13858fb-12db-4dc9-9c43-b24b1f222d9b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Acquired lock "refresh_cache-a13858fb-12db-4dc9-9c43-b24b1f222d9b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-32610f91-b8c4-40b0-b092-5a1c30e9f7ff req-c56ce3a1-6581-42f4-bb37-b2060640df3b service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Received event network-changed-67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-32610f91-b8c4-40b0-b092-5a1c30e9f7ff req-c56ce3a1-6581-42f4-bb37-b2060640df3b service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Refreshing instance network info cache due to event network-changed-67f86621-ca29-450f-9ddb-fd190c64d61e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-32610f91-b8c4-40b0-b092-5a1c30e9f7ff req-c56ce3a1-6581-42f4-bb37-b2060640df3b service nova] Acquiring lock "refresh_cache-a13858fb-12db-4dc9-9c43-b24b1f222d9b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Updating instance_info_cache with network_info: [{"id": "67f86621-ca29-450f-9ddb-fd190c64d61e", "address": "fa:16:3e:1a:2c:83", "network": {"id": "7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1451672524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97394fe74bf6412fbc561c1f7dad4af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f86621-ca", "ovs_interfaceid": "67f86621-ca29-450f-9ddb-fd190c64d61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Releasing lock "refresh_cache-a13858fb-12db-4dc9-9c43-b24b1f222d9b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Instance network_info: |[{"id": "67f86621-ca29-450f-9ddb-fd190c64d61e", "address": "fa:16:3e:1a:2c:83", "network": {"id": "7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1451672524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97394fe74bf6412fbc561c1f7dad4af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f86621-ca", "ovs_interfaceid": "67f86621-ca29-450f-9ddb-fd190c64d61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-32610f91-b8c4-40b0-b092-5a1c30e9f7ff req-c56ce3a1-6581-42f4-bb37-b2060640df3b service nova] Acquired lock "refresh_cache-a13858fb-12db-4dc9-9c43-b24b1f222d9b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.network.neutron [req-32610f91-b8c4-40b0-b092-5a1c30e9f7ff req-c56ce3a1-6581-42f4-bb37-b2060640df3b service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Refreshing network info cache for port 67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Start _get_guest_xml network_info=[{"id": "67f86621-ca29-450f-9ddb-fd190c64d61e", "address": "fa:16:3e:1a:2c:83", "network": {"id": "7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1451672524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97394fe74bf6412fbc561c1f7dad4af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f86621-ca", "ovs_interfaceid": "67f86621-ca29-450f-9ddb-fd190c64d61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:44:32 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:32 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1822769571',display_name='tempest-VolumesActionsTest-instance-1822769571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1822769571',id=19,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97394fe74bf6412fbc561c1f7dad4af0',ramdisk_id='',reservation_id='r-oiis0802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-54512603',owner_user_name='tempest-VolumesActionsTest-54512603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:44:30Z,user_data=None,user_id='bfdea97aebe645018321c9c7ca211c8c',uuid=a13858fb-12db-4dc9-9c43-b24b1f222d9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f86621-ca29-450f-9ddb-fd190c64d61e", "address": "fa:16:3e:1a:2c:83", "network": {"id": "7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1451672524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97394fe74bf6412fbc561c1f7dad4af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f86621-ca", "ovs_interfaceid": "67f86621-ca29-450f-9ddb-fd190c64d61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Converting VIF {"id": "67f86621-ca29-450f-9ddb-fd190c64d61e", "address": "fa:16:3e:1a:2c:83", "network": {"id": "7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1451672524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97394fe74bf6412fbc561c1f7dad4af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f86621-ca", "ovs_interfaceid": "67f86621-ca29-450f-9ddb-fd190c64d61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:83,bridge_name='br-int',has_traffic_filtering=True,id=67f86621-ca29-450f-9ddb-fd190c64d61e,network=Network(7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f86621-ca') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lazy-loading 'pci_devices' on Instance uuid a13858fb-12db-4dc9-9c43-b24b1f222d9b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:44:32 user nova-compute[75260]:   <uuid>a13858fb-12db-4dc9-9c43-b24b1f222d9b</uuid>
Nov 27 04:44:32 user nova-compute[75260]:   <name>instance-00000013</name>
Nov 27 04:44:32 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:44:32 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:44:32 user nova-compute[75260]:   <metadata>
Nov 27 04:44:32 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:44:32 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:44:32 user nova-compute[75260]:       <nova:name>tempest-VolumesActionsTest-instance-1822769571</nova:name>
Nov 27 04:44:32 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:44:32</nova:creationTime>
Nov 27 04:44:32 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:44:32 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:44:32 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:44:32 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:44:32 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:44:32 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:44:32 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:44:32 user nova-compute[75260]:       <nova:owner>
Nov 27 04:44:32 user nova-compute[75260]:         <nova:user uuid="bfdea97aebe645018321c9c7ca211c8c">tempest-VolumesActionsTest-54512603-project-member</nova:user>
Nov 27 04:44:32 user nova-compute[75260]:         <nova:project uuid="97394fe74bf6412fbc561c1f7dad4af0">tempest-VolumesActionsTest-54512603</nova:project>
Nov 27 04:44:32 user nova-compute[75260]:       </nova:owner>
Nov 27 04:44:32 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:44:32 user nova-compute[75260]:       <nova:ports>
Nov 27 04:44:32 user nova-compute[75260]:         <nova:port uuid="67f86621-ca29-450f-9ddb-fd190c64d61e">
Nov 27 04:44:32 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 04:44:32 user nova-compute[75260]:         </nova:port>
Nov 27 04:44:32 user nova-compute[75260]:       </nova:ports>
Nov 27 04:44:32 user nova-compute[75260]:     </nova:instance>
Nov 27 04:44:32 user nova-compute[75260]:   </metadata>
Nov 27 04:44:32 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:44:32 user nova-compute[75260]:     <system>
Nov 27 04:44:32 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:44:32 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:44:32 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:44:32 user nova-compute[75260]:       <entry name="serial">a13858fb-12db-4dc9-9c43-b24b1f222d9b</entry>
Nov 27 04:44:32 user nova-compute[75260]:       <entry name="uuid">a13858fb-12db-4dc9-9c43-b24b1f222d9b</entry>
Nov 27 04:44:32 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:44:32 user nova-compute[75260]:     </system>
Nov 27 04:44:32 user nova-compute[75260]:   </sysinfo>
Nov 27 04:44:32 user nova-compute[75260]:   <os>
Nov 27 04:44:32 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:44:32 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:44:32 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:44:32 user nova-compute[75260]:   </os>
Nov 27 04:44:32 user nova-compute[75260]:   <features>
Nov 27 04:44:32 user nova-compute[75260]:     <acpi/>
Nov 27 04:44:32 user nova-compute[75260]:     <apic/>
Nov 27 04:44:32 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:44:32 user nova-compute[75260]:   </features>
Nov 27 04:44:32 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:44:32 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:44:32 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:44:32 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:44:32 user nova-compute[75260]:   </clock>
Nov 27 04:44:32 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:44:32 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:44:32 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:44:32 user nova-compute[75260]:   </cpu>
Nov 27 04:44:32 user nova-compute[75260]:   <devices>
Nov 27 04:44:32 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:44:32 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:44:32 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk"/>
Nov 27 04:44:32 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:44:32 user nova-compute[75260]:     </disk>
Nov 27 04:44:32 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:44:32 user nova-compute[75260]:       <mac address="fa:16:3e:1a:2c:83"/>
Nov 27 04:44:32 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:44:32 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:44:32 user nova-compute[75260]:       <target dev="tap67f86621-ca"/>
Nov 27 04:44:32 user nova-compute[75260]:     </interface>
Nov 27 04:44:32 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:44:32 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/console.log" append="off"/>
Nov 27 04:44:32 user nova-compute[75260]:     </serial>
Nov 27 04:44:32 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:44:32 user nova-compute[75260]:     <video>
Nov 27 04:44:32 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:44:32 user nova-compute[75260]:     </video>
Nov 27 04:44:32 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:44:32 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:44:32 user nova-compute[75260]:     </rng>
Nov 27 04:44:32 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:44:32 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:44:32 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:44:32 user nova-compute[75260]:     </memballoon>
Nov 27 04:44:32 user nova-compute[75260]:   </devices>
Nov 27 04:44:32 user nova-compute[75260]: </domain>
Nov 27 04:44:32 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1822769571',display_name='tempest-VolumesActionsTest-instance-1822769571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1822769571',id=19,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97394fe74bf6412fbc561c1f7dad4af0',ramdisk_id='',reservation_id='r-oiis0802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-54512603',owner_user_name='tempest-VolumesActionsTest-54512603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:44:30Z,user_data=None,user_id='bfdea97aebe645018321c9c7ca211c8c',uuid=a13858fb-12db-4dc9-9c43-b24b1f222d9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f86621-ca29-450f-9ddb-fd190c64d61e", "address": "fa:16:3e:1a:2c:83", "network": {"id": "7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1451672524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97394fe74bf6412fbc561c1f7dad4af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f86621-ca", "ovs_interfaceid": "67f86621-ca29-450f-9ddb-fd190c64d61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Converting VIF {"id": "67f86621-ca29-450f-9ddb-fd190c64d61e", "address": "fa:16:3e:1a:2c:83", "network": {"id": "7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1451672524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97394fe74bf6412fbc561c1f7dad4af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f86621-ca", "ovs_interfaceid": "67f86621-ca29-450f-9ddb-fd190c64d61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:83,bridge_name='br-int',has_traffic_filtering=True,id=67f86621-ca29-450f-9ddb-fd190c64d61e,network=Network(7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f86621-ca') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG os_vif [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:83,bridge_name='br-int',has_traffic_filtering=True,id=67f86621-ca29-450f-9ddb-fd190c64d61e,network=Network(7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f86621-ca') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0e098ef-e3dc-5af1-b79f-8d54e55eab55', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67f86621-ca, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67f86621-ca, col_values=(('qos', UUID('d220962f-a669-4337-9885-d54cb4ca84d0')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67f86621-ca, col_values=(('external_ids', {'iface-id': '67f86621-ca29-450f-9ddb-fd190c64d61e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:2c:83', 'vm-uuid': 'a13858fb-12db-4dc9-9c43-b24b1f222d9b'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:32 user nova-compute[75260]: INFO os_vif [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:83,bridge_name='br-int',has_traffic_filtering=True,id=67f86621-ca29-450f-9ddb-fd190c64d61e,network=Network(7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f86621-ca')
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] No VIF found with MAC fa:16:3e:1a:2c:83, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.network.neutron [req-32610f91-b8c4-40b0-b092-5a1c30e9f7ff req-c56ce3a1-6581-42f4-bb37-b2060640df3b service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Updated VIF entry in instance network info cache for port 67f86621-ca29-450f-9ddb-fd190c64d61e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG nova.network.neutron [req-32610f91-b8c4-40b0-b092-5a1c30e9f7ff req-c56ce3a1-6581-42f4-bb37-b2060640df3b service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Updating instance_info_cache with network_info: [{"id": "67f86621-ca29-450f-9ddb-fd190c64d61e", "address": "fa:16:3e:1a:2c:83", "network": {"id": "7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1451672524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97394fe74bf6412fbc561c1f7dad4af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f86621-ca", "ovs_interfaceid": "67f86621-ca29-450f-9ddb-fd190c64d61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-32610f91-b8c4-40b0-b092-5a1c30e9f7ff req-c56ce3a1-6581-42f4-bb37-b2060640df3b service nova] Releasing lock "refresh_cache-a13858fb-12db-4dc9-9c43-b24b1f222d9b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:34 user nova-compute[75260]: DEBUG nova.compute.manager [req-33e9b2ad-4b5f-4e82-8e48-49c72614ba8b req-211186a6-106e-44f0-a673-bba9d5cf966f service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Received event network-vif-plugged-67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-33e9b2ad-4b5f-4e82-8e48-49c72614ba8b req-211186a6-106e-44f0-a673-bba9d5cf966f service nova] Acquiring lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-33e9b2ad-4b5f-4e82-8e48-49c72614ba8b req-211186a6-106e-44f0-a673-bba9d5cf966f service nova] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-33e9b2ad-4b5f-4e82-8e48-49c72614ba8b req-211186a6-106e-44f0-a673-bba9d5cf966f service nova] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:34 user nova-compute[75260]: DEBUG nova.compute.manager [req-33e9b2ad-4b5f-4e82-8e48-49c72614ba8b req-211186a6-106e-44f0-a673-bba9d5cf966f service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] No waiting events found dispatching network-vif-plugged-67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:34 user nova-compute[75260]: WARNING nova.compute.manager [req-33e9b2ad-4b5f-4e82-8e48-49c72614ba8b req-211186a6-106e-44f0-a673-bba9d5cf966f service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Received unexpected event network-vif-plugged-67f86621-ca29-450f-9ddb-fd190c64d61e for instance with vm_state building and task_state spawning.
Nov 27 04:44:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:35 user nova-compute[75260]: INFO nova.compute.manager [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Terminating instance
Nov 27 04:44:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75260) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.compute.manager [req-7a9e935d-35c1-435e-9353-4045f7f9ec31 req-7e055b73-f420-40e1-a2d3-658c4d479f8e service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Received event network-vif-plugged-67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7a9e935d-35c1-435e-9353-4045f7f9ec31 req-7e055b73-f420-40e1-a2d3-658c4d479f8e service nova] Acquiring lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7a9e935d-35c1-435e-9353-4045f7f9ec31 req-7e055b73-f420-40e1-a2d3-658c4d479f8e service nova] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7a9e935d-35c1-435e-9353-4045f7f9ec31 req-7e055b73-f420-40e1-a2d3-658c4d479f8e service nova] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.compute.manager [req-7a9e935d-35c1-435e-9353-4045f7f9ec31 req-7e055b73-f420-40e1-a2d3-658c4d479f8e service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] No waiting events found dispatching network-vif-plugged-67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:36 user nova-compute[75260]: WARNING nova.compute.manager [req-7a9e935d-35c1-435e-9353-4045f7f9ec31 req-7e055b73-f420-40e1-a2d3-658c4d479f8e service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Received unexpected event network-vif-plugged-67f86621-ca29-450f-9ddb-fd190c64d61e for instance with vm_state building and task_state spawning.
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.compute.manager [req-970bf181-d0f5-4458-9262-ed813250482f req-5e4f6e26-538a-4192-b095-f3696de924eb service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received event network-vif-unplugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-970bf181-d0f5-4458-9262-ed813250482f req-5e4f6e26-538a-4192-b095-f3696de924eb service nova] Acquiring lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-970bf181-d0f5-4458-9262-ed813250482f req-5e4f6e26-538a-4192-b095-f3696de924eb service nova] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-970bf181-d0f5-4458-9262-ed813250482f req-5e4f6e26-538a-4192-b095-f3696de924eb service nova] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.compute.manager [req-970bf181-d0f5-4458-9262-ed813250482f req-5e4f6e26-538a-4192-b095-f3696de924eb service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] No waiting events found dispatching network-vif-unplugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.compute.manager [req-970bf181-d0f5-4458-9262-ed813250482f req-5e4f6e26-538a-4192-b095-f3696de924eb service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received event network-vif-unplugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:44:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Instance destroyed successfully.
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'resources' on Instance uuid d47665e4-157a-46e2-85a3-1c5cde99db1a {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-629624880',display_name='tempest-AttachVolumeNegativeTest-server-629624880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-629624880',id=4,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBNnwS+ZrEpcayLlQ4+RI6RmiM+4kNlo2w22NYcBE4oJ8s5NPncK/OogGnP9uynN/QUv9PCf+eieULxLLUOM/r9vw4IID2KKQ6YXLv/OqlPe4yeDLddmDfJZ4soe0BoGw==',key_name='tempest-keypair-367679512',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-4gsqrqw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:39:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=d47665e4-157a-46e2-85a3-1c5cde99db1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "address": "fa:16:3e:d1:01:39", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74f921d-51", "ovs_interfaceid": "f74f921d-51d0-49a1-8cc0-4bf793bec0e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:01:39,bridge_name='br-int',has_traffic_filtering=True,id=f74f921d-51d0-49a1-8cc0-4bf793bec0e3,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74f921d-51') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG os_vif [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:01:39,bridge_name='br-int',has_traffic_filtering=True,id=f74f921d-51d0-49a1-8cc0-4bf793bec0e3,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74f921d-51') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf74f921d-51, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e04685a-c2b3-4e1d-a571-2edfaa8334aa) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:36 user nova-compute[75260]: INFO os_vif [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:01:39,bridge_name='br-int',has_traffic_filtering=True,id=f74f921d-51d0-49a1-8cc0-4bf793bec0e3,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74f921d-51')
Nov 27 04:44:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Deleting instance files /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a_del
Nov 27 04:44:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Deletion of /opt/stack/data/nova/instances/d47665e4-157a-46e2-85a3-1c5cde99db1a_del complete
Nov 27 04:44:36 user nova-compute[75260]: INFO nova.compute.manager [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 27 04:44:36 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:44:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Instance spawned successfully.
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:36 user nova-compute[75260]: INFO nova.compute.manager [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 04:44:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] There are 0 instances to clean {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 04:44:36 user nova-compute[75260]: INFO nova.compute.manager [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Took 7.53 seconds to build instance.
Nov 27 04:44:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f694ed6d-8110-4f70-8c84-9c2039c98d20 tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.638s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:37 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:37 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Took 1.20 seconds to deallocate network for instance.
Nov 27 04:44:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-606c8875-b32e-4a30-ad5d-8f5a919ba005 req-dacbd206-9538-4d28-b96d-a08749d408ea service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received event network-vif-deleted-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:37 user nova-compute[75260]: INFO nova.compute.manager [req-606c8875-b32e-4a30-ad5d-8f5a919ba005 req-dacbd206-9538-4d28-b96d-a08749d408ea service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Neutron deleted interface f74f921d-51d0-49a1-8cc0-4bf793bec0e3; detaching it from the instance and deleting it from the info cache
Nov 27 04:44:37 user nova-compute[75260]: DEBUG nova.network.neutron [req-606c8875-b32e-4a30-ad5d-8f5a919ba005 req-dacbd206-9538-4d28-b96d-a08749d408ea service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-606c8875-b32e-4a30-ad5d-8f5a919ba005 req-dacbd206-9538-4d28-b96d-a08749d408ea service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Detach interface failed, port_id=f74f921d-51d0-49a1-8cc0-4bf793bec0e3, reason: Instance d47665e4-157a-46e2-85a3-1c5cde99db1a could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:44:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:37 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:38 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:44:38 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:44:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:38 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Deleted allocations for instance d47665e4-157a-46e2-85a3-1c5cde99db1a
Nov 27 04:44:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ccf41117-c687-4834-bd67-efe1aa023ea0 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.861s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:38 user nova-compute[75260]: DEBUG nova.compute.manager [req-dec4ae15-e0a4-41ed-af65-6f9aa20a7c6f req-251c53c0-6487-4fe7-84f1-92bd653ac728 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received event network-vif-plugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-dec4ae15-e0a4-41ed-af65-6f9aa20a7c6f req-251c53c0-6487-4fe7-84f1-92bd653ac728 service nova] Acquiring lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-dec4ae15-e0a4-41ed-af65-6f9aa20a7c6f req-251c53c0-6487-4fe7-84f1-92bd653ac728 service nova] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-dec4ae15-e0a4-41ed-af65-6f9aa20a7c6f req-251c53c0-6487-4fe7-84f1-92bd653ac728 service nova] Lock "d47665e4-157a-46e2-85a3-1c5cde99db1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:38 user nova-compute[75260]: DEBUG nova.compute.manager [req-dec4ae15-e0a4-41ed-af65-6f9aa20a7c6f req-251c53c0-6487-4fe7-84f1-92bd653ac728 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] No waiting events found dispatching network-vif-plugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:38 user nova-compute[75260]: WARNING nova.compute.manager [req-dec4ae15-e0a4-41ed-af65-6f9aa20a7c6f req-251c53c0-6487-4fe7-84f1-92bd653ac728 service nova] [instance: d47665e4-157a-46e2-85a3-1c5cde99db1a] Received unexpected event network-vif-plugged-f74f921d-51d0-49a1-8cc0-4bf793bec0e3 for instance with vm_state deleted and task_state None.
Nov 27 04:44:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:39 user nova-compute[75260]: INFO nova.compute.manager [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Detaching volume 01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:44:39 user nova-compute[75260]: INFO nova.virt.block_device [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Attempting to driver detach volume 01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa from mountpoint /dev/vdb
Nov 27 04:44:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Attempting to detach device vdb from instance 12efb820-12ab-442d-a5fe-80b08f12a729 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:44:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:44:39 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:44:39 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:44:39 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:44:39 user nova-compute[75260]:   <serial>01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa</serial>
Nov 27 04:44:39 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 04:44:39 user nova-compute[75260]: </disk>
Nov 27 04:44:39 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:44:39 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully detached device vdb from instance 12efb820-12ab-442d-a5fe-80b08f12a729 from the persistent domain config.
Nov 27 04:44:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12efb820-12ab-442d-a5fe-80b08f12a729 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:44:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:44:39 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:44:39 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:44:39 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:44:39 user nova-compute[75260]:   <serial>01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa</serial>
Nov 27 04:44:39 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 04:44:39 user nova-compute[75260]: </disk>
Nov 27 04:44:39 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:44:39 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:39 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:39 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:44:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:40 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:40 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:40 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:41 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:44:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:44:42 user nova-compute[75260]: INFO nova.compute.claims [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Claim successful on node user
Nov 27 04:44:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk --force-share --output=json" returned: 0 in 0.429s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.021s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:44:43 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:44:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG nova.policy [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f65b50ae21f64a9485aa04e5eb0b0be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0f49debbfb4bc080ebad0d891ae631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:44:43 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Creating image(s)
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "/opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "/opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "/opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.168s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk 1073741824" returned: 0 in 0.069s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:43 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Successfully created port: 616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.204s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Cannot resize image /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Ensure instance console log exists: /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Port 6cb5862a-fc82-4f80-820f-02082def752d binding to destination host user is already ACTIVE {{(pid=75260) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquired lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Successfully updated port: 616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "refresh_cache-27a9c97c-e6f7-492a-808e-d3a62a57092f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquired lock "refresh_cache-27a9c97c-e6f7-492a-808e-d3a62a57092f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-95a07fd0-8a2a-48bd-a594-32321c3ae557 req-500ea2ef-5b85-44f6-8497-5f7a757afa0e service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received event network-changed-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-95a07fd0-8a2a-48bd-a594-32321c3ae557 req-500ea2ef-5b85-44f6-8497-5f7a757afa0e service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Refreshing instance network info cache due to event network-changed-616206c9-3674-4232-a547-4442283b73ad. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-95a07fd0-8a2a-48bd-a594-32321c3ae557 req-500ea2ef-5b85-44f6-8497-5f7a757afa0e service nova] Acquiring lock "refresh_cache-27a9c97c-e6f7-492a-808e-d3a62a57092f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating instance_info_cache with network_info: [{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Releasing lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Creating tmpfile /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/tmpuz9_7sne to verify with other compute node that the instance is on the same shared storage. {{(pid=75260) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Updating instance_info_cache with network_info: [{"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Releasing lock "refresh_cache-27a9c97c-e6f7-492a-808e-d3a62a57092f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Instance network_info: |[{"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-95a07fd0-8a2a-48bd-a594-32321c3ae557 req-500ea2ef-5b85-44f6-8497-5f7a757afa0e service nova] Acquired lock "refresh_cache-27a9c97c-e6f7-492a-808e-d3a62a57092f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.network.neutron [req-95a07fd0-8a2a-48bd-a594-32321c3ae557 req-500ea2ef-5b85-44f6-8497-5f7a757afa0e service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Refreshing network info cache for port 616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Start _get_guest_xml network_info=[{"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:44:45 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:45 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-386650541',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-386650541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3866505',id=20,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD99VbqL0wpTpGm93RO4qwRrWWTAlWaodgDDU/GN8NJ3snzV0CQ6/B3oru6wzTiVBN8Hchiy0ilW7Cm0VXILf5rGI98gBt1kM25vhtdR5rP1XJ70sKrVAmKIQtbQ0hdOXw==',key_name='tempest-keypair-487185593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e0f49debbfb4bc080ebad0d891ae631',ramdisk_id='',reservation_id='r-xf2fycap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679771420',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f65b50ae21f64a9485aa04e5eb0b0be1',uuid=27a9c97c-e6f7-492a-808e-d3a62a57092f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Converting VIF {"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=616206c9-3674-4232-a547-4442283b73ad,network=Network(ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616206c9-36') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.objects.instance [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lazy-loading 'pci_devices' on Instance uuid 27a9c97c-e6f7-492a-808e-d3a62a57092f {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:44:45 user nova-compute[75260]:   <uuid>27a9c97c-e6f7-492a-808e-d3a62a57092f</uuid>
Nov 27 04:44:45 user nova-compute[75260]:   <name>instance-00000014</name>
Nov 27 04:44:45 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:44:45 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:44:45 user nova-compute[75260]:   <metadata>
Nov 27 04:44:45 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:44:45 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:44:45 user nova-compute[75260]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-386650541</nova:name>
Nov 27 04:44:45 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:44:45</nova:creationTime>
Nov 27 04:44:45 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:44:45 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:44:45 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:44:45 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:44:45 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:44:45 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:44:45 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:44:45 user nova-compute[75260]:       <nova:owner>
Nov 27 04:44:45 user nova-compute[75260]:         <nova:user uuid="f65b50ae21f64a9485aa04e5eb0b0be1">tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member</nova:user>
Nov 27 04:44:45 user nova-compute[75260]:         <nova:project uuid="8e0f49debbfb4bc080ebad0d891ae631">tempest-TestServerVolumeAttachScenarioOldVersion-1679771420</nova:project>
Nov 27 04:44:45 user nova-compute[75260]:       </nova:owner>
Nov 27 04:44:45 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:44:45 user nova-compute[75260]:       <nova:ports>
Nov 27 04:44:45 user nova-compute[75260]:         <nova:port uuid="616206c9-3674-4232-a547-4442283b73ad">
Nov 27 04:44:45 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 04:44:45 user nova-compute[75260]:         </nova:port>
Nov 27 04:44:45 user nova-compute[75260]:       </nova:ports>
Nov 27 04:44:45 user nova-compute[75260]:     </nova:instance>
Nov 27 04:44:45 user nova-compute[75260]:   </metadata>
Nov 27 04:44:45 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:44:45 user nova-compute[75260]:     <system>
Nov 27 04:44:45 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:44:45 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:44:45 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:44:45 user nova-compute[75260]:       <entry name="serial">27a9c97c-e6f7-492a-808e-d3a62a57092f</entry>
Nov 27 04:44:45 user nova-compute[75260]:       <entry name="uuid">27a9c97c-e6f7-492a-808e-d3a62a57092f</entry>
Nov 27 04:44:45 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:44:45 user nova-compute[75260]:     </system>
Nov 27 04:44:45 user nova-compute[75260]:   </sysinfo>
Nov 27 04:44:45 user nova-compute[75260]:   <os>
Nov 27 04:44:45 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:44:45 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:44:45 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:44:45 user nova-compute[75260]:   </os>
Nov 27 04:44:45 user nova-compute[75260]:   <features>
Nov 27 04:44:45 user nova-compute[75260]:     <acpi/>
Nov 27 04:44:45 user nova-compute[75260]:     <apic/>
Nov 27 04:44:45 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:44:45 user nova-compute[75260]:   </features>
Nov 27 04:44:45 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:44:45 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:44:45 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:44:45 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:44:45 user nova-compute[75260]:   </clock>
Nov 27 04:44:45 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:44:45 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:44:45 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:44:45 user nova-compute[75260]:   </cpu>
Nov 27 04:44:45 user nova-compute[75260]:   <devices>
Nov 27 04:44:45 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:44:45 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:44:45 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk"/>
Nov 27 04:44:45 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:44:45 user nova-compute[75260]:     </disk>
Nov 27 04:44:45 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:44:45 user nova-compute[75260]:       <mac address="fa:16:3e:2e:d8:c0"/>
Nov 27 04:44:45 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:44:45 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:44:45 user nova-compute[75260]:       <target dev="tap616206c9-36"/>
Nov 27 04:44:45 user nova-compute[75260]:     </interface>
Nov 27 04:44:45 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:44:45 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/console.log" append="off"/>
Nov 27 04:44:45 user nova-compute[75260]:     </serial>
Nov 27 04:44:45 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:44:45 user nova-compute[75260]:     <video>
Nov 27 04:44:45 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:44:45 user nova-compute[75260]:     </video>
Nov 27 04:44:45 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:44:45 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:44:45 user nova-compute[75260]:     </rng>
Nov 27 04:44:45 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:44:45 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:44:45 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:44:45 user nova-compute[75260]:     </memballoon>
Nov 27 04:44:45 user nova-compute[75260]:   </devices>
Nov 27 04:44:45 user nova-compute[75260]: </domain>
Nov 27 04:44:45 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-386650541',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-386650541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3866505',id=20,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD99VbqL0wpTpGm93RO4qwRrWWTAlWaodgDDU/GN8NJ3snzV0CQ6/B3oru6wzTiVBN8Hchiy0ilW7Cm0VXILf5rGI98gBt1kM25vhtdR5rP1XJ70sKrVAmKIQtbQ0hdOXw==',key_name='tempest-keypair-487185593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e0f49debbfb4bc080ebad0d891ae631',ramdisk_id='',reservation_id='r-xf2fycap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679771420',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f65b50ae21f64a9485aa04e5eb0b0be1',uuid=27a9c97c-e6f7-492a-808e-d3a62a57092f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Converting VIF {"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=616206c9-3674-4232-a547-4442283b73ad,network=Network(ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616206c9-36') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG os_vif [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=616206c9-3674-4232-a547-4442283b73ad,network=Network(ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616206c9-36') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6a6b8b7-6344-583a-b634-b3245ea6d968', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap616206c9-36, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap616206c9-36, col_values=(('qos', UUID('c2a7ce0b-5107-4e80-ae1f-b88a5e4c6c5c')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap616206c9-36, col_values=(('external_ids', {'iface-id': '616206c9-3674-4232-a547-4442283b73ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:d8:c0', 'vm-uuid': '27a9c97c-e6f7-492a-808e-d3a62a57092f'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-b8215717-c1a3-4269-b92b-d20f942c1be9 req-6871c670-2ba5-417c-8716-f5f2f638745e service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-unplugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b8215717-c1a3-4269-b92b-d20f942c1be9 req-6871c670-2ba5-417c-8716-f5f2f638745e service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b8215717-c1a3-4269-b92b-d20f942c1be9 req-6871c670-2ba5-417c-8716-f5f2f638745e service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b8215717-c1a3-4269-b92b-d20f942c1be9 req-6871c670-2ba5-417c-8716-f5f2f638745e service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-b8215717-c1a3-4269-b92b-d20f942c1be9 req-6871c670-2ba5-417c-8716-f5f2f638745e service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-unplugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:45 user nova-compute[75260]: WARNING nova.compute.manager [req-b8215717-c1a3-4269-b92b-d20f942c1be9 req-6871c670-2ba5-417c-8716-f5f2f638745e service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-unplugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state resized and task_state resize_reverting.
Nov 27 04:44:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:45 user nova-compute[75260]: INFO os_vif [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=616206c9-3674-4232-a547-4442283b73ad,network=Network(ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616206c9-36')
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] No VIF found with MAC fa:16:3e:2e:d8:c0, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.network.neutron [req-95a07fd0-8a2a-48bd-a594-32321c3ae557 req-500ea2ef-5b85-44f6-8497-5f7a757afa0e service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Updated VIF entry in instance network info cache for port 616206c9-3674-4232-a547-4442283b73ad. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG nova.network.neutron [req-95a07fd0-8a2a-48bd-a594-32321c3ae557 req-500ea2ef-5b85-44f6-8497-5f7a757afa0e service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Updating instance_info_cache with network_info: [{"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-95a07fd0-8a2a-48bd-a594-32321c3ae557 req-500ea2ef-5b85-44f6-8497-5f7a757afa0e service nova] Releasing lock "refresh_cache-27a9c97c-e6f7-492a-808e-d3a62a57092f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-5661e4c6-1c7b-44e4-bb7a-890e0f0daaf0 req-88edc410-6315-4d74-8774-0409d0489dc1 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5661e4c6-1c7b-44e4-bb7a-890e0f0daaf0 req-88edc410-6315-4d74-8774-0409d0489dc1 service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5661e4c6-1c7b-44e4-bb7a-890e0f0daaf0 req-88edc410-6315-4d74-8774-0409d0489dc1 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5661e4c6-1c7b-44e4-bb7a-890e0f0daaf0 req-88edc410-6315-4d74-8774-0409d0489dc1 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-5661e4c6-1c7b-44e4-bb7a-890e0f0daaf0 req-88edc410-6315-4d74-8774-0409d0489dc1 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:50 user nova-compute[75260]: WARNING nova.compute.manager [req-5661e4c6-1c7b-44e4-bb7a-890e0f0daaf0 req-88edc410-6315-4d74-8774-0409d0489dc1 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state resized and task_state resize_reverting.
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received event network-vif-plugged-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] No waiting events found dispatching network-vif-plugged-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:50 user nova-compute[75260]: WARNING nova.compute.manager [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received unexpected event network-vif-plugged-616206c9-3674-4232-a547-4442283b73ad for instance with vm_state building and task_state spawning.
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received event network-vif-plugged-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] No waiting events found dispatching network-vif-plugged-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:50 user nova-compute[75260]: WARNING nova.compute.manager [req-0e66108c-1eff-490b-8e0e-78ad18b33ea9 req-98789379-a514-484f-a458-428034c25d59 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received unexpected event network-vif-plugged-616206c9-3674-4232-a547-4442283b73ad for instance with vm_state building and task_state spawning.
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:44:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance destroyed successfully.
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.objects.instance [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lazy-loading 'resources' on Instance uuid 3d96ab7b-3690-424e-96da-5e69b1bb1e90 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:44:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Instance spawned successfully.
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:44:50 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:50 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7463MB free_disk=25.537586212158203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1986422466',display_name='tempest-ServerActionsTestOtherB-server-1986422466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1986422466',id=5,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFB4NlyIkvuSkKdp9SCBvCksg0T5Mnmhzu1gg97fKizA6KbOPtAhyX+dbdgThddRNEEVcx1W9A9Raajm8WlZrhxaZj1ByekP4XOJKsLxLKWygxJTACdG4AQr3SivYfkcQ==',key_name='tempest-keypair-1211691950',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:43:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2dd8fd68d8c94c95908b4cd7c80082d5',ramdisk_id='',reservation_id='r-sfca6us3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1382636293',owner_user_name='tempest-ServerActionsTestOtherB-1382636293-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a14d60620b674141a4f714eac61c29d5',uuid=3d96ab7b-3690-424e-96da-5e69b1bb1e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converting VIF {"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_vif [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cb5862a-fc, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "cd971ad8-53b2-4088-9133-862ab89dc27e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:50 user nova-compute[75260]: INFO nova.compute.manager [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Terminating instance
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d667284-a173-450f-8f2e-da2220d3e46a) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:50 user nova-compute[75260]: INFO os_vif [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc')
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:44:50 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1ada6b-d827-480d-8f5c-e66c8dc2518f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:44:50 user nova-compute[75260]: No targets found.
Nov 27 04:44:50 user nova-compute[75260]: iSNS:
Nov 27 04:44:50 user nova-compute[75260]: No targets found.
Nov 27 04:44:50 user nova-compute[75260]: STATIC:
Nov 27 04:44:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:44:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:44:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:44:50 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f
Nov 27 04:44:50 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:44:50 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:44:50 user nova-compute[75260]: FIRMWARE:
Nov 27 04:44:50 user nova-compute[75260]: No targets found.
Nov 27 04:44:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:44:50 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:44:50 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ff1b8d-cd66-4c12-ae21-8e6ea0e1a992]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Applying migration context for instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90 as it has an incoming, in-progress migration 3108b385-0b0c-4385-a6f1-5197412862cf. Migration status is reverting {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 04:44:50 user nova-compute[75260]: INFO nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating resource usage from migration 3108b385-0b0c-4385-a6f1-5197412862cf
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[60780d0a-0340-48b0-bc02-ba01f0ac2476]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:44:50 user nova-compute[75260]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:44:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:44:50 user nova-compute[75260]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:44:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb542a3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:50 user nova-compute[75260]: INFO nova.compute.manager [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e616beb-a840-4a1c-8fb3-8dd81fa5ff37]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a93cbc-e88b-4cfa-b419-6a57cac3038d]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3969122-1fce-45a6-ab88-2345b92d8fd4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:50 user nova-compute[75260]: INFO nova.compute.manager [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Took 8.44 seconds to build instance.
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6791bb90-ec64-46e2-97f1-8d5ec06568f6]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bb7edd0-e32f-4d1e-a4b5-75b922e416b5 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.550s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e79a917-f528-4ff5-a6e8-0aaff0209ecb]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-ef1819f4-3684-4faf-a64f-7ab3347314d9 req-3400453f-d91e-40ea-9bcc-fad318de7a2e service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received event network-vif-unplugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ef1819f4-3684-4faf-a64f-7ab3347314d9 req-3400453f-d91e-40ea-9bcc-fad318de7a2e service nova] Acquiring lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ef1819f4-3684-4faf-a64f-7ab3347314d9 req-3400453f-d91e-40ea-9bcc-fad318de7a2e service nova] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ef1819f4-3684-4faf-a64f-7ab3347314d9 req-3400453f-d91e-40ea-9bcc-fad318de7a2e service nova] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-ef1819f4-3684-4faf-a64f-7ab3347314d9 req-3400453f-d91e-40ea-9bcc-fad318de7a2e service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] No waiting events found dispatching network-vif-unplugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-ef1819f4-3684-4faf-a64f-7ab3347314d9 req-3400453f-d91e-40ea-9bcc-fad318de7a2e service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received event network-vif-unplugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 12efb820-12ab-442d-a5fe-80b08f12a729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance cd971ad8-53b2-4088-9133-862ab89dc27e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Migration 3108b385-0b0c-4385-a6f1-5197412862cf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 2e5dcd4e-21fc-461e-bd84-9d5feca96734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d0364679-4db1-4da8-bce8-80eea41feb13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 11e38841-7318-43cf-9274-4f8a7343c76f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1100294c-ea5b-4994-885d-47357e7802c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance a13858fb-12db-4dc9-9c43-b24b1f222d9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 27a9c97c-e6f7-492a-808e-d3a62a57092f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[579aa33a-426f-49d0-a965-4df74f3b055f]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]
Nov 27 04:44:50 user nova-compute[75260]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.
Nov 27 04:44:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing inventories for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b279088-85e8-494f-9095-f415f94302bb]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.484s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] <== disconnect_volume: return (485ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating ProviderTree inventory for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing aggregate associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, aggregates: None {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 04:44:50 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing trait associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 04:44:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Instance destroyed successfully.
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.objects.instance [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lazy-loading 'resources' on Instance uuid cd971ad8-53b2-4088-9133-862ab89dc27e {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1417631610',display_name='tempest-VolumesAdminNegativeTest-server-1417631610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1417631610',id=6,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW9HC3uVolTWgWjH6HjSihVmqrafAok3qok5pFPymX7ZWyC1VRK5oqiRdezdUEwRr7eBqOsT0H4Ugk0NNXWBVInhTe+2yNJylgnjDYJEOHfbsKC5kL/hUngfFFar/0FOg==',key_name='tempest-keypair-7806836',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='deff7f2657d442a89aa29b3de5e9680c',ramdisk_id='',reservation_id='r-yz5mre2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-494319220',owner_user_name='tempest-VolumesAdminNegativeTest-494319220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:39:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87cf690bdffe48d39b62bf09cca81d90',uuid=cd971ad8-53b2-4088-9133-862ab89dc27e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converting VIF {"id": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "address": "fa:16:3e:df:93:63", "network": {"id": "27801485-4166-4dcd-a920-d5ab3e76a927", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716116964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deff7f2657d442a89aa29b3de5e9680c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9f1b45-41", "ovs_interfaceid": "cc9f1b45-41d8-4d4c-9396-d9ac528d5783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:93:63,bridge_name='br-int',has_traffic_filtering=True,id=cc9f1b45-41d8-4d4c-9396-d9ac528d5783,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9f1b45-41') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG os_vif [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:93:63,bridge_name='br-int',has_traffic_filtering=True,id=cc9f1b45-41d8-4d4c-9396-d9ac528d5783,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9f1b45-41') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc9f1b45-41, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=254c7b22-bb5f-4e6c-9f02-91536003b3c4) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:44:51 user nova-compute[75260]: INFO os_vif [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:93:63,bridge_name='br-int',has_traffic_filtering=True,id=cc9f1b45-41d8-4d4c-9396-d9ac528d5783,network=Network(27801485-4166-4dcd-a920-d5ab3e76a927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9f1b45-41')
Nov 27 04:44:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Deleting instance files /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e_del
Nov 27 04:44:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Deletion of /opt/stack/data/nova/instances/cd971ad8-53b2-4088-9133-862ab89dc27e_del complete
Nov 27 04:44:51 user nova-compute[75260]: INFO nova.compute.manager [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 27 04:44:51 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.178s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.objects.instance [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lazy-loading 'migration_context' on Instance uuid 3d96ab7b-3690-424e-96da-5e69b1bb1e90 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:44:51 user nova-compute[75260]: DEBUG nova.objects.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Object Instance<3d96ab7b-3690-424e-96da-5e69b1bb1e90> lazy-loaded attributes: resources,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.515s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:52 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Took 1.02 seconds to deallocate network for instance.
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:44:52 user nova-compute[75260]: INFO nova.compute.manager [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Swapping old allocation on dict_keys(['f7a986a0-eb41-409b-bde9-ec0b97496a7b']) held by migration 3108b385-0b0c-4385-a6f1-5197412862cf for instance
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Overwriting current allocation {'allocations': {'f7a986a0-eb41-409b-bde9-ec0b97496a7b': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': '2dd8fd68d8c94c95908b4cd7c80082d5', 'user_id': 'a14d60620b674141a4f714eac61c29d5', 'consumer_generation': 1} on consumer 3d96ab7b-3690-424e-96da-5e69b1bb1e90 {{(pid=75260) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquired lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-cd971ad8-53b2-4088-9133-862ab89dc27e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-9197e28e-1992-435d-8671-0a4a7cbc294b req-9871ad40-ad0b-4117-b2c2-a1d813df34d7 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received event network-vif-plugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9197e28e-1992-435d-8671-0a4a7cbc294b req-9871ad40-ad0b-4117-b2c2-a1d813df34d7 service nova] Acquiring lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9197e28e-1992-435d-8671-0a4a7cbc294b req-9871ad40-ad0b-4117-b2c2-a1d813df34d7 service nova] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9197e28e-1992-435d-8671-0a4a7cbc294b req-9871ad40-ad0b-4117-b2c2-a1d813df34d7 service nova] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-9197e28e-1992-435d-8671-0a4a7cbc294b req-9871ad40-ad0b-4117-b2c2-a1d813df34d7 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] No waiting events found dispatching network-vif-plugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:44:52 user nova-compute[75260]: WARNING nova.compute.manager [req-9197e28e-1992-435d-8671-0a4a7cbc294b req-9871ad40-ad0b-4117-b2c2-a1d813df34d7 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received unexpected event network-vif-plugged-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 for instance with vm_state deleted and task_state None.
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-9197e28e-1992-435d-8671-0a4a7cbc294b req-9871ad40-ad0b-4117-b2c2-a1d813df34d7 service nova] [instance: cd971ad8-53b2-4088-9133-862ab89dc27e] Received event network-vif-deleted-cc9f1b45-41d8-4d4c-9396-d9ac528d5783 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:44:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.596s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:52 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Deleted allocations for instance cd971ad8-53b2-4088-9133-862ab89dc27e
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22a54c0d-170e-490c-a39f-ffb8b2ee68ea tempest-VolumesAdminNegativeTest-494319220 tempest-VolumesAdminNegativeTest-494319220-project-member] Lock "cd971ad8-53b2-4088-9133-862ab89dc27e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.878s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating instance_info_cache with network_info: [{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Releasing lock "refresh_cache-3d96ab7b-3690-424e-96da-5e69b1bb1e90" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG os_brick.utils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc63bf6-d7e0-49cf-bd43-6a03029f60a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e132ce20-f4ba-455a-b280-05a44ef08a8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b5d2a-6b58-4674-aa9e-0dbce86b6ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[012f3d67-20b7-4b4f-ae0a-f97c6e246e83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:44:53 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:44:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bb2452-52cc-42c4-9e0a-3ed71e978aa9]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:44:53 user nova-compute[75260]: DEBUG os_brick.utils [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:44:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Starting finish_revert_migration {{(pid=75260) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Start _get_guest_xml network_info=[{"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '817dcb32-74e8-40e6-b682-c579a5398184', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3d96ab7b-3690-424e-96da-5e69b1bb1e90', 'attached_at': '2023-11-27T04:44:59.000000', 'detached_at': '', 'volume_id': '47c204d7-0a62-4fec-bba4-635ccecba25f', 'serial': '47c204d7-0a62-4fec-bba4-635ccecba25f'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:44:59 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:59 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.objects.instance [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d96ab7b-3690-424e-96da-5e69b1bb1e90 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:44:59 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:44:59 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:44:59 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cf3f9f-8c7b-4d1f-8ccf-50646ae77e35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:44:59 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef524a1-19e0-468c-ba34-ef644d256b4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f] added
Nov 27 04:44:59 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c337f2-cbee-499f-9392-89d0dfacca3c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5795daf-ef59-47f2-bd3e-8c24531abab3]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXmcrsSB {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXmcrsSB" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa402748-2f31-4226-9fa7-7c083e5cb0f7]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXmcrsSB'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b167cf3-2d8c-4ac4-9f48-9d0c4dedf0bb]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb069d2-b055-4605-8747-5cd4565ca968]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:44:59 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:44:59 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aa182d-b295-402b-9e8f-a15d65bb37f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]
Nov 27 04:44:59 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.
Nov 27 04:44:59 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c334fe41-4f1b-49b2-b490-8d0baa86976a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: WARNING nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid d8cd1732-d408-4ef3-85b6-94b12ba7f5ad {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 3d96ab7b-3690-424e-96da-5e69b1bb1e90 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 2e5dcd4e-21fc-461e-bd84-9d5feca96734 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid d0364679-4db1-4da8-bce8-80eea41feb13 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 11e38841-7318-43cf-9274-4f8a7343c76f {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid a13858fb-12db-4dc9-9c43-b24b1f222d9b {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 27a9c97c-e6f7-492a-808e-d3a62a57092f {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "7c01d799-540f-469b-8417-5af70d803adf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:59 user nova-compute[75260]: INFO nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "d0364679-4db1-4da8-bce8-80eea41feb13" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "d0364679-4db1-4da8-bce8-80eea41feb13" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "11e38841-7318-43cf-9274-4f8a7343c76f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "11e38841-7318-43cf-9274-4f8a7343c76f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "1100294c-ea5b-4994-885d-47357e7802c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1243e221-27cb-4ca4-acab-aea1e771a5ca]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:44:59 user nova-compute[75260]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:44:59 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:44:59 user nova-compute[75260]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:44:59 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4f965d-6371-4ca1-b58c-ccf96dfe4ee5]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "7c01d799-540f-469b-8417-5af70d803adf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "11e38841-7318-43cf-9274-4f8a7343c76f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "d0364679-4db1-4da8-bce8-80eea41feb13" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "1100294c-ea5b-4994-885d-47357e7802c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:44:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:00 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 12efb820-12ab-442d-a5fe-80b08f12a729 is timed out.
Nov 27 04:45:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully detached device vdb from instance 12efb820-12ab-442d-a5fe-80b08f12a729 from the live domain config.
Nov 27 04:45:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnWiRhvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:45:00 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26438393036623231', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438393036623231', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.652s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1986422466',display_name='tempest-ServerActionsTestOtherB-server-1986422466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1986422466',id=5,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFB4NlyIkvuSkKdp9SCBvCksg0T5Mnmhzu1gg97fKizA6KbOPtAhyX+dbdgThddRNEEVcx1W9A9Raajm8WlZrhxaZj1ByekP4XOJKsLxLKWygxJTACdG4AQr3SivYfkcQ==',key_name='tempest-keypair-1211691950',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:43:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd8fd68d8c94c95908b4cd7c80082d5',ramdisk_id='',reservation_id='r-sfca6us3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1382636293',owner_user_name='tempest-ServerActionsTestOtherB-1382636293-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a14d60620b674141a4f714eac61c29d5',uuid=3d96ab7b-3690-424e-96da-5e69b1bb1e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converting VIF {"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:45:00 user nova-compute[75260]:   <uuid>3d96ab7b-3690-424e-96da-5e69b1bb1e90</uuid>
Nov 27 04:45:00 user nova-compute[75260]:   <name>instance-00000005</name>
Nov 27 04:45:00 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:45:00 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:45:00 user nova-compute[75260]:   <metadata>
Nov 27 04:45:00 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:45:00 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:45:00 user nova-compute[75260]:       <nova:name>tempest-ServerActionsTestOtherB-server-1986422466</nova:name>
Nov 27 04:45:00 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:44:59</nova:creationTime>
Nov 27 04:45:00 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:45:00 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:45:00 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:45:00 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:45:00 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:45:00 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:45:00 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:45:00 user nova-compute[75260]:       <nova:owner>
Nov 27 04:45:00 user nova-compute[75260]:         <nova:user uuid="a14d60620b674141a4f714eac61c29d5">tempest-ServerActionsTestOtherB-1382636293-project-member</nova:user>
Nov 27 04:45:00 user nova-compute[75260]:         <nova:project uuid="2dd8fd68d8c94c95908b4cd7c80082d5">tempest-ServerActionsTestOtherB-1382636293</nova:project>
Nov 27 04:45:00 user nova-compute[75260]:       </nova:owner>
Nov 27 04:45:00 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:45:00 user nova-compute[75260]:       <nova:ports>
Nov 27 04:45:00 user nova-compute[75260]:         <nova:port uuid="6cb5862a-fc82-4f80-820f-02082def752d">
Nov 27 04:45:00 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 04:45:00 user nova-compute[75260]:         </nova:port>
Nov 27 04:45:00 user nova-compute[75260]:       </nova:ports>
Nov 27 04:45:00 user nova-compute[75260]:     </nova:instance>
Nov 27 04:45:00 user nova-compute[75260]:   </metadata>
Nov 27 04:45:00 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:45:00 user nova-compute[75260]:     <system>
Nov 27 04:45:00 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:45:00 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:45:00 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:45:00 user nova-compute[75260]:       <entry name="serial">3d96ab7b-3690-424e-96da-5e69b1bb1e90</entry>
Nov 27 04:45:00 user nova-compute[75260]:       <entry name="uuid">3d96ab7b-3690-424e-96da-5e69b1bb1e90</entry>
Nov 27 04:45:00 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:45:00 user nova-compute[75260]:     </system>
Nov 27 04:45:00 user nova-compute[75260]:   </sysinfo>
Nov 27 04:45:00 user nova-compute[75260]:   <os>
Nov 27 04:45:00 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:45:00 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:45:00 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:45:00 user nova-compute[75260]:   </os>
Nov 27 04:45:00 user nova-compute[75260]:   <features>
Nov 27 04:45:00 user nova-compute[75260]:     <acpi/>
Nov 27 04:45:00 user nova-compute[75260]:     <apic/>
Nov 27 04:45:00 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:45:00 user nova-compute[75260]:   </features>
Nov 27 04:45:00 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:45:00 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:45:00 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:45:00 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:45:00 user nova-compute[75260]:   </clock>
Nov 27 04:45:00 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:45:00 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:45:00 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:45:00 user nova-compute[75260]:   </cpu>
Nov 27 04:45:00 user nova-compute[75260]:   <devices>
Nov 27 04:45:00 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:45:00 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:45:00 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk"/>
Nov 27 04:45:00 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:45:00 user nova-compute[75260]:     </disk>
Nov 27 04:45:00 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:45:00 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:45:00 user nova-compute[75260]:       <source dev="/dev/sdb"/>
Nov 27 04:45:00 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:45:00 user nova-compute[75260]:       <serial>47c204d7-0a62-4fec-bba4-635ccecba25f</serial>
Nov 27 04:45:00 user nova-compute[75260]:     </disk>
Nov 27 04:45:00 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:45:00 user nova-compute[75260]:       <mac address="fa:16:3e:aa:95:ab"/>
Nov 27 04:45:00 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:45:00 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:45:00 user nova-compute[75260]:       <target dev="tap6cb5862a-fc"/>
Nov 27 04:45:00 user nova-compute[75260]:     </interface>
Nov 27 04:45:00 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:45:00 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/console.log" append="off"/>
Nov 27 04:45:00 user nova-compute[75260]:     </serial>
Nov 27 04:45:00 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:45:00 user nova-compute[75260]:     <video>
Nov 27 04:45:00 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:45:00 user nova-compute[75260]:     </video>
Nov 27 04:45:00 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:45:00 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:45:00 user nova-compute[75260]:     </rng>
Nov 27 04:45:00 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:45:00 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:45:00 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:45:00 user nova-compute[75260]:     </memballoon>
Nov 27 04:45:00 user nova-compute[75260]:   </devices>
Nov 27 04:45:00 user nova-compute[75260]: </domain>
Nov 27 04:45:00 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1986422466',display_name='tempest-ServerActionsTestOtherB-server-1986422466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1986422466',id=5,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFB4NlyIkvuSkKdp9SCBvCksg0T5Mnmhzu1gg97fKizA6KbOPtAhyX+dbdgThddRNEEVcx1W9A9Raajm8WlZrhxaZj1ByekP4XOJKsLxLKWygxJTACdG4AQr3SivYfkcQ==',key_name='tempest-keypair-1211691950',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:43:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd8fd68d8c94c95908b4cd7c80082d5',ramdisk_id='',reservation_id='r-sfca6us3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1382636293',owner_user_name='tempest-ServerActionsTestOtherB-1382636293-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a14d60620b674141a4f714eac61c29d5',uuid=3d96ab7b-3690-424e-96da-5e69b1bb1e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converting VIF {"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_vif [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ae54b6-7ebc-4330-959a-e1fce6bb44f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:45:00 user nova-compute[75260]: No targets found.
Nov 27 04:45:00 user nova-compute[75260]: iSNS:
Nov 27 04:45:00 user nova-compute[75260]: No targets found.
Nov 27 04:45:00 user nova-compute[75260]: STATIC:
Nov 27 04:45:00 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa
Nov 27 04:45:00 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:45:00 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:45:00 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f
Nov 27 04:45:00 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:45:00 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:45:00 user nova-compute[75260]: FIRMWARE:
Nov 27 04:45:00 user nova-compute[75260]: No targets found.
Nov 27 04:45:00 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:45:00 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:45:00 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9076afbe-9d15-54b9-907f-abfa4e0b995b', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cb5862a-fc, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cb5862a-fc, col_values=(('qos', UUID('1612ed45-00bf-4bcf-bf06-d06ec39ce553')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cb5862a-fc, col_values=(('external_ids', {'iface-id': '6cb5862a-fc82-4f80-820f-02082def752d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:95:ab', 'vm-uuid': '3d96ab7b-3690-424e-96da-5e69b1bb1e90'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4337ef0b-6066-408f-90cd-e5dfcdf5a2bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:00 user nova-compute[75260]: INFO os_vif [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc')
Nov 27 04:45:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c77e292-648b-4dd8-a3a4-0d26f8f626ba]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:45:00 user nova-compute[75260]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:45:00 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa (non-flash)
Nov 27 04:45:00 user nova-compute[75260]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:45:00 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb544a56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:45:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f2b537-5a84-42b2-bdc4-581210357d86]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c60b5-fc9b-4ae5-8117-079ab6d29644]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce6f021-840d-446c-91bc-38a25d3f0640]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cb24c8-d59b-4136-bbb3-7b5cb288a992]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f815b0-6011-4e2c-bfce-c8269a0298bb]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd1e7fb-07ed-4fab-b989-cd9541c299f2]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260]
Nov 27 04:45:01 user nova-compute[75260]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa, portal: 172.16.0.220,3260] successful.
Nov 27 04:45:01 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a4df45-d2f2-4f8a-a64b-e96b0e9be2fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef02a78d-b768-474b-ac69-56836a4897ab]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== disconnect_volume: return (961ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG nova.objects.instance [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lazy-loading 'flavor' on Instance uuid 2e5dcd4e-21fc-461e-bd84-9d5feca96734 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:45:01 user nova-compute[75260]: DEBUG nova.objects.instance [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eda1276b-f7dd-4a1e-9105-9a2f624e22cb tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.375s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.203s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:02 user nova-compute[75260]: INFO nova.compute.manager [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Attaching volume 856726b6-0aea-4e2c-9975-5dd046619026 to /dev/vdb
Nov 27 04:45:02 user nova-compute[75260]: DEBUG os_brick.utils [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22619e2-4c93-44a8-8c88-9a1a2fda1542]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc135237-aa33-4120-ae59-7276a6566591]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa0a6c7-c5e5-4435-b833-1bbc5e277fdc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5900b65-aec6-4861-b748-1711fc4ceadd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:45:02 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6e36bc-fa9d-45d9-a547-76bd1b3f1f6c]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG os_brick.utils [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Updating existing volume attachment record: 4a47ff1f-f34a-4841-9cbe-50d826430edb {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ad4bef58-f0fc-40e2-bc37-30751b96948c tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ad4bef58-f0fc-40e2-bc37-30751b96948c tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-ad4bef58-f0fc-40e2-bc37-30751b96948c tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-ad4bef58-f0fc-40e2-bc37-30751b96948c tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75260) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG nova.objects.instance [None req-ad4bef58-f0fc-40e2-bc37-30751b96948c tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-bdfbe169-4b79-4ccb-bb4d-715613e6fb34 req-17a2320d-95c5-4e11-a88d-ab889b419359 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bdfbe169-4b79-4ccb-bb4d-715613e6fb34 req-17a2320d-95c5-4e11-a88d-ab889b419359 service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bdfbe169-4b79-4ccb-bb4d-715613e6fb34 req-17a2320d-95c5-4e11-a88d-ab889b419359 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bdfbe169-4b79-4ccb-bb4d-715613e6fb34 req-17a2320d-95c5-4e11-a88d-ab889b419359 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-bdfbe169-4b79-4ccb-bb4d-715613e6fb34 req-17a2320d-95c5-4e11-a88d-ab889b419359 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:02 user nova-compute[75260]: WARNING nova.compute.manager [req-bdfbe169-4b79-4ccb-bb4d-715613e6fb34 req-17a2320d-95c5-4e11-a88d-ab889b419359 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state resized and task_state resize_reverting.
Nov 27 04:45:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:03 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance destroyed successfully.
Nov 27 04:45:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-ad4bef58-f0fc-40e2-bc37-30751b96948c tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:45:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ad4bef58-f0fc-40e2-bc37-30751b96948c tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.164s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:04 user nova-compute[75260]: WARNING nova.compute.manager [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state resized and task_state resize_reverting.
Nov 27 04:45:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-unplugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] No waiting events found dispatching network-vif-unplugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:04 user nova-compute[75260]: WARNING nova.compute.manager [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received unexpected event network-vif-unplugged-e07f49c0-b893-44bf-a195-c351eadfe333 for instance with vm_state stopped and task_state None.
Nov 27 04:45:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] No waiting events found dispatching network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:04 user nova-compute[75260]: WARNING nova.compute.manager [req-f631b9b7-c71c-4adf-8cba-8f3935aeffe1 req-ebaa63af-1b4b-4157-8ed5-2c5c400aacb5 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received unexpected event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 for instance with vm_state stopped and task_state None.
Nov 27 04:45:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:45:04 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance running successfully.
Nov 27 04:45:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] finish_revert_migration finished successfully. {{(pid=75260) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 27 04:45:04 user nova-compute[75260]: INFO nova.compute.manager [None req-1fda3478-87b7-42af-9e10-424a759076f7 tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating instance to original state: 'active'
Nov 27 04:45:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hyITsuNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:45:08 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:45:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:45:08 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:45:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:45:08 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6efd764-26fb-43cf-b21e-aa5d80ecdd5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:45:08 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4aa92e-b634-47a0-ba5a-3268893dacab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026] added
Nov 27 04:45:08 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc54c59-9789-455d-b4e2-bc6124d773b9]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39b79f1-5abb-4af8-b607-47d275cf1674]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hyITsuNP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hyITsuNP" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a457330-fcb6-494e-b2d0-157f5f080a43]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hyITsuNP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f9108a-43d3-40ed-8673-f7cb7ec1d499]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[89975610-561e-4336-acd4-60b35a267c75]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:45:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:45:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6c747f-9f58-40b1-83bf-712f26a680c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026, portal: 172.16.0.220,3260]
Nov 27 04:45:09 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026, portal: 172.16.0.220,3260] successful.
Nov 27 04:45:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a2a34b-da2b-41ed-8c61-f360e23a50be]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a74a2f7-2d33-4eb1-9c01-a11860e316e3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:45:09 user nova-compute[75260]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 (non-flash)
Nov 27 04:45:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:45:09 user nova-compute[75260]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 (non-flash)
Nov 27 04:45:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b4cd20-edbc-4223-8abe-21989099ba06]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:45:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hyITsuNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:45:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:45:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23533346539356666', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:45:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533346539356666', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:45:10 user nova-compute[75260]: DEBUG nova.objects.instance [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lazy-loading 'flavor' on Instance uuid 2e5dcd4e-21fc-461e-bd84-9d5feca96734 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:45:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:45:10 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:45:10 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:45:10 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:45:10 user nova-compute[75260]:   <serial>856726b6-0aea-4e2c-9975-5dd046619026</serial>
Nov 27 04:45:10 user nova-compute[75260]: </disk>
Nov 27 04:45:10 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:45:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:45:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:45:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] No VIF found with MAC fa:16:3e:b0:c8:65, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:45:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a679103-85fb-47fe-8b85-cb600fb8465b tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.591s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:11 user nova-compute[75260]: INFO nova.compute.manager [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Terminating instance
Nov 27 04:45:11 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-68e2b043-c757-4074-b915-cca1d298056d req-48dee885-7ad0-43eb-8b14-d14bb6941ff2 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-unplugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-68e2b043-c757-4074-b915-cca1d298056d req-48dee885-7ad0-43eb-8b14-d14bb6941ff2 service nova] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-68e2b043-c757-4074-b915-cca1d298056d req-48dee885-7ad0-43eb-8b14-d14bb6941ff2 service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-68e2b043-c757-4074-b915-cca1d298056d req-48dee885-7ad0-43eb-8b14-d14bb6941ff2 service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-68e2b043-c757-4074-b915-cca1d298056d req-48dee885-7ad0-43eb-8b14-d14bb6941ff2 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] No waiting events found dispatching network-vif-unplugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-68e2b043-c757-4074-b915-cca1d298056d req-48dee885-7ad0-43eb-8b14-d14bb6941ff2 service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-unplugged-e4af270f-11b4-47d9-940a-d6447490c06c for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Instance destroyed successfully.
Nov 27 04:45:12 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lazy-loading 'resources' on Instance uuid 2e5dcd4e-21fc-461e-bd84-9d5feca96734 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1028767430',display_name='tempest-DeleteServersTestJSON-server-1028767430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1028767430',id=15,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:43:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c7fae6471154459ac5169efd57c2f9f',ramdisk_id='',reservation_id='r-b7nfwfcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1858595482',owner_user_name='tempest-DeleteServersTestJSON-1858595482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:43:17Z,user_data=None,user_id='eae8deecf9a748398f0e318a54d5fd2a',uuid=2e5dcd4e-21fc-461e-bd84-9d5feca96734,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4af270f-11b4-47d9-940a-d6447490c06c", "address": "fa:16:3e:b0:c8:65", "network": {"id": "92316a04-44f8-4c59-88af-e3da3be0233b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1548678715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7fae6471154459ac5169efd57c2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4af270f-11", "ovs_interfaceid": "e4af270f-11b4-47d9-940a-d6447490c06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Converting VIF {"id": "e4af270f-11b4-47d9-940a-d6447490c06c", "address": "fa:16:3e:b0:c8:65", "network": {"id": "92316a04-44f8-4c59-88af-e3da3be0233b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1548678715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7fae6471154459ac5169efd57c2f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4af270f-11", "ovs_interfaceid": "e4af270f-11b4-47d9-940a-d6447490c06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c8:65,bridge_name='br-int',has_traffic_filtering=True,id=e4af270f-11b4-47d9-940a-d6447490c06c,network=Network(92316a04-44f8-4c59-88af-e3da3be0233b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4af270f-11') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_vif [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c8:65,bridge_name='br-int',has_traffic_filtering=True,id=e4af270f-11b4-47d9-940a-d6447490c06c,network=Network(92316a04-44f8-4c59-88af-e3da3be0233b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4af270f-11') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4af270f-11, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4aad3a26-9378-4e18-b39c-50d49e19623b) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:12 user nova-compute[75260]: INFO os_vif [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c8:65,bridge_name='br-int',has_traffic_filtering=True,id=e4af270f-11b4-47d9-940a-d6447490c06c,network=Network(92316a04-44f8-4c59-88af-e3da3be0233b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4af270f-11')
Nov 27 04:45:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hyITsuNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:45:12 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8beded4-bb73-4b7f-91fa-93eaf69b91d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:45:12 user nova-compute[75260]: No targets found.
Nov 27 04:45:12 user nova-compute[75260]: iSNS:
Nov 27 04:45:12 user nova-compute[75260]: No targets found.
Nov 27 04:45:12 user nova-compute[75260]: STATIC:
Nov 27 04:45:12 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026
Nov 27 04:45:12 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:45:12 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:45:12 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f
Nov 27 04:45:12 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:45:12 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:45:12 user nova-compute[75260]: FIRMWARE:
Nov 27 04:45:12 user nova-compute[75260]: No targets found.
Nov 27 04:45:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:45:12 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:45:12 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3ccf0e-c2f5-4dff-9ebe-3e365bce4cc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de6929d-f146-43e4-9f8b-be692684510e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:45:12 user nova-compute[75260]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 (non-flash)
Nov 27 04:45:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:45:12 user nova-compute[75260]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 (non-flash)
Nov 27 04:45:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54223010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a51b8c5-351f-48bc-9108-09b951ae424c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[876af5e7-90ad-40eb-b8b4-0622a4b4694c]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7294e83c-10f2-48bb-9127-ed334feed4ae]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df21e97-cafd-49cd-8398-058f366e3f4e]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7ed83b-bd36-4418-a166-55773a9e1c0a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec76a777-5eb9-4fa8-9c8e-5642a13cb834]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026, portal: 172.16.0.220,3260]
Nov 27 04:45:13 user nova-compute[75260]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026, portal: 172.16.0.220,3260] successful.
Nov 27 04:45:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856726b6-0aea-4e2c-9975-5dd046619026 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf129f72-f9fc-4e31-9184-5d1af2301f97]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] <== disconnect_volume: return (315ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:45:13 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Deleting instance files /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734_del
Nov 27 04:45:13 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Deletion of /opt/stack/data/nova/instances/2e5dcd4e-21fc-461e-bd84-9d5feca96734_del complete
Nov 27 04:45:13 user nova-compute[75260]: INFO nova.compute.manager [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 27 04:45:13 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:13 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:45:13 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Took 0.72 seconds to deallocate network for instance.
Nov 27 04:45:13 user nova-compute[75260]: DEBUG nova.compute.manager [req-b3b18767-b618-47d0-86aa-6773c6527432 req-211b5b6a-844e-4ab5-ade4-6ea75f0990da service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-deleted-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] No waiting events found dispatching network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:14 user nova-compute[75260]: WARNING nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received unexpected event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c for instance with vm_state active and task_state deleting.
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] No waiting events found dispatching network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:14 user nova-compute[75260]: WARNING nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received unexpected event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c for instance with vm_state active and task_state deleting.
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] No waiting events found dispatching network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:14 user nova-compute[75260]: WARNING nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received unexpected event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c for instance with vm_state active and task_state deleting.
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-unplugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] No waiting events found dispatching network-vif-unplugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-unplugged-e4af270f-11b4-47d9-940a-d6447490c06c for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Acquiring lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] No waiting events found dispatching network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:14 user nova-compute[75260]: WARNING nova.compute.manager [req-c77b7e6a-f7b5-4f8b-b98f-0aa20a665500 req-019f0000-ab47-4441-a1b2-fe205932887e service nova] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Received unexpected event network-vif-plugged-e4af270f-11b4-47d9-940a-d6447490c06c for instance with vm_state active and task_state deleting.
Nov 27 04:45:14 user nova-compute[75260]: INFO nova.compute.manager [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] [instance: 2e5dcd4e-21fc-461e-bd84-9d5feca96734] Took 0.76 seconds to detach 1 volumes for instance.
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:15 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:45:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:45:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:15 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Deleted allocations for instance 2e5dcd4e-21fc-461e-bd84-9d5feca96734
Nov 27 04:45:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f0756926-ebe5-4905-9507-886931882b38 tempest-DeleteServersTestJSON-1858595482 tempest-DeleteServersTestJSON-1858595482-project-member] Lock "2e5dcd4e-21fc-461e-bd84-9d5feca96734" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.244s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:20 user nova-compute[75260]: INFO nova.compute.manager [None req-22cf0f0d-cdc8-4119-bbe1-0767687da34c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Unrescuing
Nov 27 04:45:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22cf0f0d-cdc8-4119-bbe1-0767687da34c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22cf0f0d-cdc8-4119-bbe1-0767687da34c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquired lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-22cf0f0d-cdc8-4119-bbe1-0767687da34c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-22cf0f0d-cdc8-4119-bbe1-0767687da34c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updating instance_info_cache with network_info: [{"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-22cf0f0d-cdc8-4119-bbe1-0767687da34c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Releasing lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG nova.objects.instance [None req-22cf0f0d-cdc8-4119-bbe1-0767687da34c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'flavor' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-2c2ec117-e02b-4457-a852-8e177f7483ea req-0b163a23-9a33-4359-8070-9c084d1052a4 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-unplugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2c2ec117-e02b-4457-a852-8e177f7483ea req-0b163a23-9a33-4359-8070-9c084d1052a4 service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2c2ec117-e02b-4457-a852-8e177f7483ea req-0b163a23-9a33-4359-8070-9c084d1052a4 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2c2ec117-e02b-4457-a852-8e177f7483ea req-0b163a23-9a33-4359-8070-9c084d1052a4 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-2c2ec117-e02b-4457-a852-8e177f7483ea req-0b163a23-9a33-4359-8070-9c084d1052a4 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-unplugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:20 user nova-compute[75260]: WARNING nova.compute.manager [req-2c2ec117-e02b-4457-a852-8e177f7483ea req-0b163a23-9a33-4359-8070-9c084d1052a4 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-unplugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:45:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Instance destroyed successfully.
Nov 27 04:45:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:22 user nova-compute[75260]: WARNING nova.compute.manager [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:45:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:22 user nova-compute[75260]: WARNING nova.compute.manager [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:45:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:22 user nova-compute[75260]: WARNING nova.compute.manager [req-eeaecded-9ef0-4a38-9aca-87d266f0bc7b req-a2d6f912-24e4-4006-acae-546fdaf2f944 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:45:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:24 user nova-compute[75260]: DEBUG nova.compute.manager [None req-22cf0f0d-cdc8-4119-bbe1-0767687da34c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:45:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d732c23b-281e-44db-8af0-26d045278b80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:45:29 user nova-compute[75260]: INFO nova.compute.claims [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Claim successful on node user
Nov 27 04:45:29 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:45:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:45:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:45:29 user nova-compute[75260]: DEBUG nova.policy [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1b9f31e8cfe433ba6988d8be95ff00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a01c78567be4d4ca62fd53ad2937ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:45:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Creating image(s)
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "/opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "/opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "/opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.230s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk 1073741824" returned: 0 in 0.048s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Successfully created port: 16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.204s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Cannot resize image /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Ensure instance console log exists: /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Successfully updated port: 16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "refresh_cache-d732c23b-281e-44db-8af0-26d045278b80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquired lock "refresh_cache-d732c23b-281e-44db-8af0-26d045278b80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-ea4618d0-ed68-466b-9618-fcaf6e14126a req-3d4f5b92-d8a1-4f3a-abfc-326f8ae1a65c service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received event network-changed-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-ea4618d0-ed68-466b-9618-fcaf6e14126a req-3d4f5b92-d8a1-4f3a-abfc-326f8ae1a65c service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Refreshing instance network info cache due to event network-changed-16903aa8-5484-4e72-a5e6-888a35864372. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ea4618d0-ed68-466b-9618-fcaf6e14126a req-3d4f5b92-d8a1-4f3a-abfc-326f8ae1a65c service nova] Acquiring lock "refresh_cache-d732c23b-281e-44db-8af0-26d045278b80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Updating instance_info_cache with network_info: [{"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Releasing lock "refresh_cache-d732c23b-281e-44db-8af0-26d045278b80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Instance network_info: |[{"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ea4618d0-ed68-466b-9618-fcaf6e14126a req-3d4f5b92-d8a1-4f3a-abfc-326f8ae1a65c service nova] Acquired lock "refresh_cache-d732c23b-281e-44db-8af0-26d045278b80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.network.neutron [req-ea4618d0-ed68-466b-9618-fcaf6e14126a req-3d4f5b92-d8a1-4f3a-abfc-326f8ae1a65c service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Refreshing network info cache for port 16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Start _get_guest_xml network_info=[{"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:45:31 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:45:31 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1821962666',display_name='tempest-AttachVolumeNegativeTest-server-1821962666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1821962666',id=21,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+JrLLO++qgoTZ7krjv2mhJXv5F6m8PgCO0U41fj3bg3uksb6E9RccfCWPgAgKgGxzGHxv+xULC3gT9rGh1JvsIX6YVpqqfoEtlwnCU/HHZXxsnJkcxuwVvpSLCoDoRdg==',key_name='tempest-keypair-1954803909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-be38f61a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=d732c23b-281e-44db-8af0-26d045278b80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:26:49,bridge_name='br-int',has_traffic_filtering=True,id=16903aa8-5484-4e72-a5e6-888a35864372,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16903aa8-54') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'pci_devices' on Instance uuid d732c23b-281e-44db-8af0-26d045278b80 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:45:31 user nova-compute[75260]:   <uuid>d732c23b-281e-44db-8af0-26d045278b80</uuid>
Nov 27 04:45:31 user nova-compute[75260]:   <name>instance-00000015</name>
Nov 27 04:45:31 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:45:31 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:45:31 user nova-compute[75260]:   <metadata>
Nov 27 04:45:31 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:45:31 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:45:31 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1821962666</nova:name>
Nov 27 04:45:31 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:45:31</nova:creationTime>
Nov 27 04:45:31 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:45:31 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:45:31 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:45:31 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:45:31 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:45:31 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:45:31 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:45:31 user nova-compute[75260]:       <nova:owner>
Nov 27 04:45:31 user nova-compute[75260]:         <nova:user uuid="a1b9f31e8cfe433ba6988d8be95ff00c">tempest-AttachVolumeNegativeTest-1561165574-project-member</nova:user>
Nov 27 04:45:31 user nova-compute[75260]:         <nova:project uuid="1a01c78567be4d4ca62fd53ad2937ff5">tempest-AttachVolumeNegativeTest-1561165574</nova:project>
Nov 27 04:45:31 user nova-compute[75260]:       </nova:owner>
Nov 27 04:45:31 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:45:31 user nova-compute[75260]:       <nova:ports>
Nov 27 04:45:31 user nova-compute[75260]:         <nova:port uuid="16903aa8-5484-4e72-a5e6-888a35864372">
Nov 27 04:45:31 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 04:45:31 user nova-compute[75260]:         </nova:port>
Nov 27 04:45:31 user nova-compute[75260]:       </nova:ports>
Nov 27 04:45:31 user nova-compute[75260]:     </nova:instance>
Nov 27 04:45:31 user nova-compute[75260]:   </metadata>
Nov 27 04:45:31 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:45:31 user nova-compute[75260]:     <system>
Nov 27 04:45:31 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:45:31 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:45:31 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:45:31 user nova-compute[75260]:       <entry name="serial">d732c23b-281e-44db-8af0-26d045278b80</entry>
Nov 27 04:45:31 user nova-compute[75260]:       <entry name="uuid">d732c23b-281e-44db-8af0-26d045278b80</entry>
Nov 27 04:45:31 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:45:31 user nova-compute[75260]:     </system>
Nov 27 04:45:31 user nova-compute[75260]:   </sysinfo>
Nov 27 04:45:31 user nova-compute[75260]:   <os>
Nov 27 04:45:31 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:45:31 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:45:31 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:45:31 user nova-compute[75260]:   </os>
Nov 27 04:45:31 user nova-compute[75260]:   <features>
Nov 27 04:45:31 user nova-compute[75260]:     <acpi/>
Nov 27 04:45:31 user nova-compute[75260]:     <apic/>
Nov 27 04:45:31 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:45:31 user nova-compute[75260]:   </features>
Nov 27 04:45:31 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:45:31 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:45:31 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:45:31 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:45:31 user nova-compute[75260]:   </clock>
Nov 27 04:45:31 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:45:31 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:45:31 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:45:31 user nova-compute[75260]:   </cpu>
Nov 27 04:45:31 user nova-compute[75260]:   <devices>
Nov 27 04:45:31 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:45:31 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:45:31 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk"/>
Nov 27 04:45:31 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:45:31 user nova-compute[75260]:     </disk>
Nov 27 04:45:31 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:45:31 user nova-compute[75260]:       <mac address="fa:16:3e:cb:26:49"/>
Nov 27 04:45:31 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:45:31 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:45:31 user nova-compute[75260]:       <target dev="tap16903aa8-54"/>
Nov 27 04:45:31 user nova-compute[75260]:     </interface>
Nov 27 04:45:31 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:45:31 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/console.log" append="off"/>
Nov 27 04:45:31 user nova-compute[75260]:     </serial>
Nov 27 04:45:31 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:45:31 user nova-compute[75260]:     <video>
Nov 27 04:45:31 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:45:31 user nova-compute[75260]:     </video>
Nov 27 04:45:31 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:45:31 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:45:31 user nova-compute[75260]:     </rng>
Nov 27 04:45:31 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:45:31 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:45:31 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:45:31 user nova-compute[75260]:     </memballoon>
Nov 27 04:45:31 user nova-compute[75260]:   </devices>
Nov 27 04:45:31 user nova-compute[75260]: </domain>
Nov 27 04:45:31 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1821962666',display_name='tempest-AttachVolumeNegativeTest-server-1821962666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1821962666',id=21,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+JrLLO++qgoTZ7krjv2mhJXv5F6m8PgCO0U41fj3bg3uksb6E9RccfCWPgAgKgGxzGHxv+xULC3gT9rGh1JvsIX6YVpqqfoEtlwnCU/HHZXxsnJkcxuwVvpSLCoDoRdg==',key_name='tempest-keypair-1954803909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-be38f61a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=d732c23b-281e-44db-8af0-26d045278b80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:26:49,bridge_name='br-int',has_traffic_filtering=True,id=16903aa8-5484-4e72-a5e6-888a35864372,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16903aa8-54') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG os_vif [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:26:49,bridge_name='br-int',has_traffic_filtering=True,id=16903aa8-5484-4e72-a5e6-888a35864372,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16903aa8-54') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67ae7538-5077-5f51-bd36-abc4d10b290b', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16903aa8-54, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16903aa8-54, col_values=(('qos', UUID('464c787b-1232-48ba-9008-e414ae105108')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16903aa8-54, col_values=(('external_ids', {'iface-id': '16903aa8-5484-4e72-a5e6-888a35864372', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:26:49', 'vm-uuid': 'd732c23b-281e-44db-8af0-26d045278b80'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:45:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:32 user nova-compute[75260]: INFO os_vif [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:26:49,bridge_name='br-int',has_traffic_filtering=True,id=16903aa8-5484-4e72-a5e6-888a35864372,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16903aa8-54')
Nov 27 04:45:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:45:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No VIF found with MAC fa:16:3e:cb:26:49, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:45:32 user nova-compute[75260]: DEBUG nova.network.neutron [req-ea4618d0-ed68-466b-9618-fcaf6e14126a req-3d4f5b92-d8a1-4f3a-abfc-326f8ae1a65c service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Updated VIF entry in instance network info cache for port 16903aa8-5484-4e72-a5e6-888a35864372. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:45:32 user nova-compute[75260]: DEBUG nova.network.neutron [req-ea4618d0-ed68-466b-9618-fcaf6e14126a req-3d4f5b92-d8a1-4f3a-abfc-326f8ae1a65c service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Updating instance_info_cache with network_info: [{"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:45:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ea4618d0-ed68-466b-9618-fcaf6e14126a req-3d4f5b92-d8a1-4f3a-abfc-326f8ae1a65c service nova] Releasing lock "refresh_cache-d732c23b-281e-44db-8af0-26d045278b80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:45:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:33 user nova-compute[75260]: DEBUG nova.compute.manager [req-6deb3918-1d85-4c02-8324-97841e8cca9d req-74877429-5f0b-4250-8658-bd7ce22006ad service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received event network-vif-plugged-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6deb3918-1d85-4c02-8324-97841e8cca9d req-74877429-5f0b-4250-8658-bd7ce22006ad service nova] Acquiring lock "d732c23b-281e-44db-8af0-26d045278b80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6deb3918-1d85-4c02-8324-97841e8cca9d req-74877429-5f0b-4250-8658-bd7ce22006ad service nova] Lock "d732c23b-281e-44db-8af0-26d045278b80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6deb3918-1d85-4c02-8324-97841e8cca9d req-74877429-5f0b-4250-8658-bd7ce22006ad service nova] Lock "d732c23b-281e-44db-8af0-26d045278b80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:33 user nova-compute[75260]: DEBUG nova.compute.manager [req-6deb3918-1d85-4c02-8324-97841e8cca9d req-74877429-5f0b-4250-8658-bd7ce22006ad service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] No waiting events found dispatching network-vif-plugged-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:33 user nova-compute[75260]: WARNING nova.compute.manager [req-6deb3918-1d85-4c02-8324-97841e8cca9d req-74877429-5f0b-4250-8658-bd7ce22006ad service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received unexpected event network-vif-plugged-16903aa8-5484-4e72-a5e6-888a35864372 for instance with vm_state building and task_state spawning.
Nov 27 04:45:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:45:34 user nova-compute[75260]: INFO nova.compute.claims [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Claim successful on node user
Nov 27 04:45:34 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.network.neutron [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:45:35 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.policy [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f5e727696d94f35a7f111cfa01a2530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2fd7cc4144d4422a140157d994f8c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:45:35 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Creating image(s)
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "/opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "/opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "/opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:45:35 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d732c23b-281e-44db-8af0-26d045278b80] Instance spawned successfully.
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk 1073741824" returned: 0 in 0.061s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.compute.manager [req-c21aad34-4c1e-4b7c-bbab-2b3188c7e7a3 req-a40c40ad-ed24-4776-b7c3-c0993c43cd39 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received event network-vif-plugged-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c21aad34-4c1e-4b7c-bbab-2b3188c7e7a3 req-a40c40ad-ed24-4776-b7c3-c0993c43cd39 service nova] Acquiring lock "d732c23b-281e-44db-8af0-26d045278b80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c21aad34-4c1e-4b7c-bbab-2b3188c7e7a3 req-a40c40ad-ed24-4776-b7c3-c0993c43cd39 service nova] Lock "d732c23b-281e-44db-8af0-26d045278b80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c21aad34-4c1e-4b7c-bbab-2b3188c7e7a3 req-a40c40ad-ed24-4776-b7c3-c0993c43cd39 service nova] Lock "d732c23b-281e-44db-8af0-26d045278b80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.compute.manager [req-c21aad34-4c1e-4b7c-bbab-2b3188c7e7a3 req-a40c40ad-ed24-4776-b7c3-c0993c43cd39 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] No waiting events found dispatching network-vif-plugged-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:35 user nova-compute[75260]: WARNING nova.compute.manager [req-c21aad34-4c1e-4b7c-bbab-2b3188c7e7a3 req-a40c40ad-ed24-4776-b7c3-c0993c43cd39 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received unexpected event network-vif-plugged-16903aa8-5484-4e72-a5e6-888a35864372 for instance with vm_state building and task_state spawning.
Nov 27 04:45:35 user nova-compute[75260]: INFO nova.compute.manager [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.network.neutron [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Successfully created port: 0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:45:35 user nova-compute[75260]: INFO nova.compute.manager [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Took 6.54 seconds to build instance.
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2ed3d741-e317-481e-943e-64b6f9668d82 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.639s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.221s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:45:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Cannot resize image /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Ensure instance console log exists: /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Successfully updated port: 0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "refresh_cache-30d6ebaa-7c35-4eeb-8a06-789e691fbf08" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquired lock "refresh_cache-30d6ebaa-7c35-4eeb-8a06-789e691fbf08" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.compute.manager [req-c752a131-4c87-413b-b2d8-7a03d2f790f7 req-7053686e-c605-4b11-bdad-e7c0c4e0f097 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Received event network-changed-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.compute.manager [req-c752a131-4c87-413b-b2d8-7a03d2f790f7 req-7053686e-c605-4b11-bdad-e7c0c4e0f097 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Refreshing instance network info cache due to event network-changed-0093ecb2-78ec-4a7e-ba61-7b542b0d9020. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c752a131-4c87-413b-b2d8-7a03d2f790f7 req-7053686e-c605-4b11-bdad-e7c0c4e0f097 service nova] Acquiring lock "refresh_cache-30d6ebaa-7c35-4eeb-8a06-789e691fbf08" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Updating instance_info_cache with network_info: [{"id": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "address": "fa:16:3e:79:18:c8", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0093ecb2-78", "ovs_interfaceid": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Releasing lock "refresh_cache-30d6ebaa-7c35-4eeb-8a06-789e691fbf08" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Instance network_info: |[{"id": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "address": "fa:16:3e:79:18:c8", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0093ecb2-78", "ovs_interfaceid": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c752a131-4c87-413b-b2d8-7a03d2f790f7 req-7053686e-c605-4b11-bdad-e7c0c4e0f097 service nova] Acquired lock "refresh_cache-30d6ebaa-7c35-4eeb-8a06-789e691fbf08" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.network.neutron [req-c752a131-4c87-413b-b2d8-7a03d2f790f7 req-7053686e-c605-4b11-bdad-e7c0c4e0f097 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Refreshing network info cache for port 0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Start _get_guest_xml network_info=[{"id": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "address": "fa:16:3e:79:18:c8", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0093ecb2-78", "ovs_interfaceid": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:45:36 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:45:36 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1716276371',display_name='tempest-ServersNegativeTestJSON-server-1716276371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1716276371',id=22,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2fd7cc4144d4422a140157d994f8c06',ramdisk_id='',reservation_id='r-r87c0c0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1694781308',owner_user_name='tempest-ServersNegativeTestJSON-1694781308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:45:35Z,user_data=None,user_id='1f5e727696d94f35a7f111cfa01a2530',uuid=30d6ebaa-7c35-4eeb-8a06-789e691fbf08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "address": "fa:16:3e:79:18:c8", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0093ecb2-78", "ovs_interfaceid": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converting VIF {"id": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "address": "fa:16:3e:79:18:c8", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0093ecb2-78", "ovs_interfaceid": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:c8,bridge_name='br-int',has_traffic_filtering=True,id=0093ecb2-78ec-4a7e-ba61-7b542b0d9020,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0093ecb2-78') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lazy-loading 'pci_devices' on Instance uuid 30d6ebaa-7c35-4eeb-8a06-789e691fbf08 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:45:36 user nova-compute[75260]:   <uuid>30d6ebaa-7c35-4eeb-8a06-789e691fbf08</uuid>
Nov 27 04:45:36 user nova-compute[75260]:   <name>instance-00000016</name>
Nov 27 04:45:36 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:45:36 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:45:36 user nova-compute[75260]:   <metadata>
Nov 27 04:45:36 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:45:36 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:45:36 user nova-compute[75260]:       <nova:name>tempest-ServersNegativeTestJSON-server-1716276371</nova:name>
Nov 27 04:45:36 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:45:36</nova:creationTime>
Nov 27 04:45:36 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:45:36 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:45:36 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:45:36 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:45:36 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:45:36 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:45:36 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:45:36 user nova-compute[75260]:       <nova:owner>
Nov 27 04:45:36 user nova-compute[75260]:         <nova:user uuid="1f5e727696d94f35a7f111cfa01a2530">tempest-ServersNegativeTestJSON-1694781308-project-member</nova:user>
Nov 27 04:45:36 user nova-compute[75260]:         <nova:project uuid="d2fd7cc4144d4422a140157d994f8c06">tempest-ServersNegativeTestJSON-1694781308</nova:project>
Nov 27 04:45:36 user nova-compute[75260]:       </nova:owner>
Nov 27 04:45:36 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:45:36 user nova-compute[75260]:       <nova:ports>
Nov 27 04:45:36 user nova-compute[75260]:         <nova:port uuid="0093ecb2-78ec-4a7e-ba61-7b542b0d9020">
Nov 27 04:45:36 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 27 04:45:36 user nova-compute[75260]:         </nova:port>
Nov 27 04:45:36 user nova-compute[75260]:       </nova:ports>
Nov 27 04:45:36 user nova-compute[75260]:     </nova:instance>
Nov 27 04:45:36 user nova-compute[75260]:   </metadata>
Nov 27 04:45:36 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:45:36 user nova-compute[75260]:     <system>
Nov 27 04:45:36 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:45:36 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:45:36 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:45:36 user nova-compute[75260]:       <entry name="serial">30d6ebaa-7c35-4eeb-8a06-789e691fbf08</entry>
Nov 27 04:45:36 user nova-compute[75260]:       <entry name="uuid">30d6ebaa-7c35-4eeb-8a06-789e691fbf08</entry>
Nov 27 04:45:36 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:45:36 user nova-compute[75260]:     </system>
Nov 27 04:45:36 user nova-compute[75260]:   </sysinfo>
Nov 27 04:45:36 user nova-compute[75260]:   <os>
Nov 27 04:45:36 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:45:36 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:45:36 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:45:36 user nova-compute[75260]:   </os>
Nov 27 04:45:36 user nova-compute[75260]:   <features>
Nov 27 04:45:36 user nova-compute[75260]:     <acpi/>
Nov 27 04:45:36 user nova-compute[75260]:     <apic/>
Nov 27 04:45:36 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:45:36 user nova-compute[75260]:   </features>
Nov 27 04:45:36 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:45:36 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:45:36 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:45:36 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:45:36 user nova-compute[75260]:   </clock>
Nov 27 04:45:36 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:45:36 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:45:36 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:45:36 user nova-compute[75260]:   </cpu>
Nov 27 04:45:36 user nova-compute[75260]:   <devices>
Nov 27 04:45:36 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:45:36 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:45:36 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk"/>
Nov 27 04:45:36 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:45:36 user nova-compute[75260]:     </disk>
Nov 27 04:45:36 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:45:36 user nova-compute[75260]:       <mac address="fa:16:3e:79:18:c8"/>
Nov 27 04:45:36 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:45:36 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:45:36 user nova-compute[75260]:       <target dev="tap0093ecb2-78"/>
Nov 27 04:45:36 user nova-compute[75260]:     </interface>
Nov 27 04:45:36 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:45:36 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/console.log" append="off"/>
Nov 27 04:45:36 user nova-compute[75260]:     </serial>
Nov 27 04:45:36 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:45:36 user nova-compute[75260]:     <video>
Nov 27 04:45:36 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:45:36 user nova-compute[75260]:     </video>
Nov 27 04:45:36 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:45:36 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:45:36 user nova-compute[75260]:     </rng>
Nov 27 04:45:36 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:45:36 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:45:36 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:45:36 user nova-compute[75260]:     </memballoon>
Nov 27 04:45:36 user nova-compute[75260]:   </devices>
Nov 27 04:45:36 user nova-compute[75260]: </domain>
Nov 27 04:45:36 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1716276371',display_name='tempest-ServersNegativeTestJSON-server-1716276371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1716276371',id=22,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2fd7cc4144d4422a140157d994f8c06',ramdisk_id='',reservation_id='r-r87c0c0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1694781308',owner_user_name='tempest-ServersNegativeTestJSON-1694781308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:45:35Z,user_data=None,user_id='1f5e727696d94f35a7f111cfa01a2530',uuid=30d6ebaa-7c35-4eeb-8a06-789e691fbf08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "address": "fa:16:3e:79:18:c8", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0093ecb2-78", "ovs_interfaceid": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converting VIF {"id": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "address": "fa:16:3e:79:18:c8", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0093ecb2-78", "ovs_interfaceid": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:c8,bridge_name='br-int',has_traffic_filtering=True,id=0093ecb2-78ec-4a7e-ba61-7b542b0d9020,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0093ecb2-78') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG os_vif [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:c8,bridge_name='br-int',has_traffic_filtering=True,id=0093ecb2-78ec-4a7e-ba61-7b542b0d9020,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0093ecb2-78') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '557a2f0c-1df4-553b-835f-6e407f87b17f', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0093ecb2-78, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0093ecb2-78, col_values=(('qos', UUID('6145b284-d191-42c4-b18a-b1374e45e759')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0093ecb2-78, col_values=(('external_ids', {'iface-id': '0093ecb2-78ec-4a7e-ba61-7b542b0d9020', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:18:c8', 'vm-uuid': '30d6ebaa-7c35-4eeb-8a06-789e691fbf08'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:45:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:36 user nova-compute[75260]: INFO os_vif [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:c8,bridge_name='br-int',has_traffic_filtering=True,id=0093ecb2-78ec-4a7e-ba61-7b542b0d9020,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0093ecb2-78')
Nov 27 04:45:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:45:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] No VIF found with MAC fa:16:3e:79:18:c8, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:45:37 user nova-compute[75260]: DEBUG nova.network.neutron [req-c752a131-4c87-413b-b2d8-7a03d2f790f7 req-7053686e-c605-4b11-bdad-e7c0c4e0f097 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Updated VIF entry in instance network info cache for port 0093ecb2-78ec-4a7e-ba61-7b542b0d9020. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:45:37 user nova-compute[75260]: DEBUG nova.network.neutron [req-c752a131-4c87-413b-b2d8-7a03d2f790f7 req-7053686e-c605-4b11-bdad-e7c0c4e0f097 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Updating instance_info_cache with network_info: [{"id": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "address": "fa:16:3e:79:18:c8", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0093ecb2-78", "ovs_interfaceid": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:45:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c752a131-4c87-413b-b2d8-7a03d2f790f7 req-7053686e-c605-4b11-bdad-e7c0c4e0f097 service nova] Releasing lock "refresh_cache-30d6ebaa-7c35-4eeb-8a06-789e691fbf08" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:45:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:38 user nova-compute[75260]: DEBUG nova.compute.manager [req-2298b544-fa49-40c7-a877-dbd15382c301 req-e7f7b1ba-c137-433a-b8de-2df26f712c2f service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Received event network-vif-plugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2298b544-fa49-40c7-a877-dbd15382c301 req-e7f7b1ba-c137-433a-b8de-2df26f712c2f service nova] Acquiring lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2298b544-fa49-40c7-a877-dbd15382c301 req-e7f7b1ba-c137-433a-b8de-2df26f712c2f service nova] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2298b544-fa49-40c7-a877-dbd15382c301 req-e7f7b1ba-c137-433a-b8de-2df26f712c2f service nova] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:38 user nova-compute[75260]: DEBUG nova.compute.manager [req-2298b544-fa49-40c7-a877-dbd15382c301 req-e7f7b1ba-c137-433a-b8de-2df26f712c2f service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] No waiting events found dispatching network-vif-plugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:38 user nova-compute[75260]: WARNING nova.compute.manager [req-2298b544-fa49-40c7-a877-dbd15382c301 req-e7f7b1ba-c137-433a-b8de-2df26f712c2f service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Received unexpected event network-vif-plugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 for instance with vm_state building and task_state spawning.
Nov 27 04:45:38 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:45:39 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:45:40 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Instance spawned successfully.
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.compute.manager [req-33da540b-488b-4a89-9e59-143f796021ad req-82602f45-62b7-47d9-9eef-2f8b635cb9c4 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Received event network-vif-plugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-33da540b-488b-4a89-9e59-143f796021ad req-82602f45-62b7-47d9-9eef-2f8b635cb9c4 service nova] Acquiring lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-33da540b-488b-4a89-9e59-143f796021ad req-82602f45-62b7-47d9-9eef-2f8b635cb9c4 service nova] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-33da540b-488b-4a89-9e59-143f796021ad req-82602f45-62b7-47d9-9eef-2f8b635cb9c4 service nova] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.compute.manager [req-33da540b-488b-4a89-9e59-143f796021ad req-82602f45-62b7-47d9-9eef-2f8b635cb9c4 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] No waiting events found dispatching network-vif-plugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:40 user nova-compute[75260]: WARNING nova.compute.manager [req-33da540b-488b-4a89-9e59-143f796021ad req-82602f45-62b7-47d9-9eef-2f8b635cb9c4 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Received unexpected event network-vif-plugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 for instance with vm_state building and task_state spawning.
Nov 27 04:45:40 user nova-compute[75260]: INFO nova.compute.manager [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:45:40 user nova-compute[75260]: INFO nova.compute.manager [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Took 6.43 seconds to build instance.
Nov 27 04:45:40 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bac006cd-4ec0-4f7a-83ce-98ec1bb93b84 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.537s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:40 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:45:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:46 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:45:46 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:45:46 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7452MB free_disk=25.523693084716797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:45:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 12efb820-12ab-442d-a5fe-80b08f12a729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d0364679-4db1-4da8-bce8-80eea41feb13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 11e38841-7318-43cf-9274-4f8a7343c76f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1100294c-ea5b-4994-885d-47357e7802c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance a13858fb-12db-4dc9-9c43-b24b1f222d9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 27a9c97c-e6f7-492a-808e-d3a62a57092f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d732c23b-281e-44db-8af0-26d045278b80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 30d6ebaa-7c35-4eeb-8a06-789e691fbf08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:45:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:45:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:45:48 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:45:48 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 04:45:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:45:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:45:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:45:48 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Acquiring lock "11e38841-7318-43cf-9274-4f8a7343c76f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "11e38841-7318-43cf-9274-4f8a7343c76f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Acquiring lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:49 user nova-compute[75260]: INFO nova.compute.manager [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Terminating instance
Nov 27 04:45:49 user nova-compute[75260]: DEBUG nova.compute.manager [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-c8e0b1b8-40d2-41ff-aa91-ca6b7dde8db4 req-6ca7cc47-48c1-445a-8ae1-31b535cb42de service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Received event network-vif-unplugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c8e0b1b8-40d2-41ff-aa91-ca6b7dde8db4 req-6ca7cc47-48c1-445a-8ae1-31b535cb42de service nova] Acquiring lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c8e0b1b8-40d2-41ff-aa91-ca6b7dde8db4 req-6ca7cc47-48c1-445a-8ae1-31b535cb42de service nova] Lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c8e0b1b8-40d2-41ff-aa91-ca6b7dde8db4 req-6ca7cc47-48c1-445a-8ae1-31b535cb42de service nova] Lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-c8e0b1b8-40d2-41ff-aa91-ca6b7dde8db4 req-6ca7cc47-48c1-445a-8ae1-31b535cb42de service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] No waiting events found dispatching network-vif-unplugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-c8e0b1b8-40d2-41ff-aa91-ca6b7dde8db4 req-6ca7cc47-48c1-445a-8ae1-31b535cb42de service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Received event network-vif-unplugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:45:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Instance destroyed successfully.
Nov 27 04:45:50 user nova-compute[75260]: DEBUG nova.objects.instance [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lazy-loading 'resources' on Instance uuid 11e38841-7318-43cf-9274-4f8a7343c76f {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1122825738',display_name='tempest-VolumesNegativeTest-instance-1122825738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1122825738',id=17,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:44:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bf60fe2979a464b9373bbcb002cf84d',ramdisk_id='',reservation_id='r-0i9wfuof',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1570116772',owner_user_name='tempest-VolumesNegativeTest-1570116772-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:07Z,user_data=None,user_id='14516d1255c8413a804939fcc6d88735',uuid=11e38841-7318-43cf-9274-4f8a7343c76f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "address": "fa:16:3e:d2:16:fe", "network": {"id": "11791783-1ddf-472a-8d2f-d4914c1cf3e6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e2eec6901a284b46afc99dbeefbc586f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1842c9a-f6", "ovs_interfaceid": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Converting VIF {"id": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "address": "fa:16:3e:d2:16:fe", "network": {"id": "11791783-1ddf-472a-8d2f-d4914c1cf3e6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e2eec6901a284b46afc99dbeefbc586f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1842c9a-f6", "ovs_interfaceid": "a1842c9a-f6c1-4a31-aa72-5cebe1c68b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1842c9a-f6c1-4a31-aa72-5cebe1c68b30,network=Network(11791783-1ddf-472a-8d2f-d4914c1cf3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1842c9a-f6') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG os_vif [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1842c9a-f6c1-4a31-aa72-5cebe1c68b30,network=Network(11791783-1ddf-472a-8d2f-d4914c1cf3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1842c9a-f6') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1842c9a-f6, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee706bc2-5bd2-4af7-9b51-f0d29d989e9c) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:50 user nova-compute[75260]: INFO os_vif [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1842c9a-f6c1-4a31-aa72-5cebe1c68b30,network=Network(11791783-1ddf-472a-8d2f-d4914c1cf3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1842c9a-f6')
Nov 27 04:45:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Deleting instance files /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f_del
Nov 27 04:45:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Deletion of /opt/stack/data/nova/instances/11e38841-7318-43cf-9274-4f8a7343c76f_del complete
Nov 27 04:45:50 user nova-compute[75260]: INFO nova.compute.manager [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 27 04:45:50 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-dd29e6b9-48fd-4fe1-8017-eb1444172297 req-12cf4ca0-1ef1-4188-a2ec-4547af986658 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Received event network-vif-deleted-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:50 user nova-compute[75260]: INFO nova.compute.manager [req-dd29e6b9-48fd-4fe1-8017-eb1444172297 req-12cf4ca0-1ef1-4188-a2ec-4547af986658 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Neutron deleted interface a1842c9a-f6c1-4a31-aa72-5cebe1c68b30; detaching it from the instance and deleting it from the info cache
Nov 27 04:45:50 user nova-compute[75260]: DEBUG nova.network.neutron [req-dd29e6b9-48fd-4fe1-8017-eb1444172297 req-12cf4ca0-1ef1-4188-a2ec-4547af986658 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:45:50 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Took 0.56 seconds to deallocate network for instance.
Nov 27 04:45:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-dd29e6b9-48fd-4fe1-8017-eb1444172297 req-12cf4ca0-1ef1-4188-a2ec-4547af986658 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Detach interface failed, port_id=a1842c9a-f6c1-4a31-aa72-5cebe1c68b30, reason: Instance 11e38841-7318-43cf-9274-4f8a7343c76f could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:51 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:45:51 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:45:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:51 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Deleted allocations for instance 11e38841-7318-43cf-9274-4f8a7343c76f
Nov 27 04:45:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-85048310-3dd0-499d-8e7a-7a57bbf77244 tempest-VolumesNegativeTest-1570116772 tempest-VolumesNegativeTest-1570116772-project-member] Lock "11e38841-7318-43cf-9274-4f8a7343c76f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.776s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-5dd53fa6-b31c-4649-90b0-43603523413b req-0429ac9b-2658-4341-aff8-324082aff582 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Received event network-vif-plugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:45:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5dd53fa6-b31c-4649-90b0-43603523413b req-0429ac9b-2658-4341-aff8-324082aff582 service nova] Acquiring lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5dd53fa6-b31c-4649-90b0-43603523413b req-0429ac9b-2658-4341-aff8-324082aff582 service nova] Lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5dd53fa6-b31c-4649-90b0-43603523413b req-0429ac9b-2658-4341-aff8-324082aff582 service nova] Lock "11e38841-7318-43cf-9274-4f8a7343c76f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-5dd53fa6-b31c-4649-90b0-43603523413b req-0429ac9b-2658-4341-aff8-324082aff582 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] No waiting events found dispatching network-vif-plugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:45:52 user nova-compute[75260]: WARNING nova.compute.manager [req-5dd53fa6-b31c-4649-90b0-43603523413b req-0429ac9b-2658-4341-aff8-324082aff582 service nova] [instance: 11e38841-7318-43cf-9274-4f8a7343c76f] Received unexpected event network-vif-plugged-a1842c9a-f6c1-4a31-aa72-5cebe1c68b30 for instance with vm_state deleted and task_state None.
Nov 27 04:45:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:45:58 user nova-compute[75260]: INFO nova.compute.claims [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Claim successful on node user
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:45:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.policy [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bbc381d6509448db6f2b23ec2a609d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efcdc0a7701245aaae5d18694ec3e0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:45:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Creating image(s)
Nov 27 04:45:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk 1073741824" returned: 0 in 0.051s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Successfully created port: 08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Cannot resize image /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Ensure instance console log exists: /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:45:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Successfully updated port: 08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquired lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-c239bc79-786b-41c9-9009-448c80fe3908 req-0618c29b-922d-4afa-8c4f-07b5ff20f493 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-changed-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-c239bc79-786b-41c9-9009-448c80fe3908 req-0618c29b-922d-4afa-8c4f-07b5ff20f493 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Refreshing instance network info cache due to event network-changed-08fcec14-f146-4deb-861b-02af609bfd4e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c239bc79-786b-41c9-9009-448c80fe3908 req-0618c29b-922d-4afa-8c4f-07b5ff20f493 service nova] Acquiring lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updating instance_info_cache with network_info: [{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Releasing lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Instance network_info: |[{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c239bc79-786b-41c9-9009-448c80fe3908 req-0618c29b-922d-4afa-8c4f-07b5ff20f493 service nova] Acquired lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-c239bc79-786b-41c9-9009-448c80fe3908 req-0618c29b-922d-4afa-8c4f-07b5ff20f493 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Refreshing network info cache for port 08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Start _get_guest_xml network_info=[{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:46:00 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:46:00 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1343339764',display_name='tempest-ServerStableDeviceRescueTest-server-1343339764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1343339764',id=23,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTQN+/2CjAEBmT4+S+1zo64Z0W5v1lvMJnT95nxxyeuCKn1YzWu5h2Sgpil050tma7PbOyqmOUnEFI32sPfr1Lq9oY/oSHuA9d3TuhQeiSZENua0tyJQOXqlfYvzCbiAw==',key_name='tempest-keypair-817121387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efcdc0a7701245aaae5d18694ec3e0e4',ramdisk_id='',reservation_id='r-1j1jr746',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1298117882',owner_user_name='tempest-ServerStableDeviceRescueTest-1298117882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbc381d6509448db6f2b23ec2a609d2',uuid=57ee8ff0-df13-4f15-96a0-c324b10dd9a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Converting VIF {"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:c8:81,bridge_name='br-int',has_traffic_filtering=True,id=08fcec14-f146-4deb-861b-02af609bfd4e,network=Network(eaa843ad-ee5c-45a7-ad9f-103049904426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fcec14-f1') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.objects.instance [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'pci_devices' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:46:00 user nova-compute[75260]:   <uuid>57ee8ff0-df13-4f15-96a0-c324b10dd9a7</uuid>
Nov 27 04:46:00 user nova-compute[75260]:   <name>instance-00000017</name>
Nov 27 04:46:00 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:46:00 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:46:00 user nova-compute[75260]:   <metadata>
Nov 27 04:46:00 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:46:00 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:46:00 user nova-compute[75260]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1343339764</nova:name>
Nov 27 04:46:00 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:46:00</nova:creationTime>
Nov 27 04:46:00 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:46:00 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:46:00 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:46:00 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:46:00 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:46:00 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:46:00 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:46:00 user nova-compute[75260]:       <nova:owner>
Nov 27 04:46:00 user nova-compute[75260]:         <nova:user uuid="7bbc381d6509448db6f2b23ec2a609d2">tempest-ServerStableDeviceRescueTest-1298117882-project-member</nova:user>
Nov 27 04:46:00 user nova-compute[75260]:         <nova:project uuid="efcdc0a7701245aaae5d18694ec3e0e4">tempest-ServerStableDeviceRescueTest-1298117882</nova:project>
Nov 27 04:46:00 user nova-compute[75260]:       </nova:owner>
Nov 27 04:46:00 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:46:00 user nova-compute[75260]:       <nova:ports>
Nov 27 04:46:00 user nova-compute[75260]:         <nova:port uuid="08fcec14-f146-4deb-861b-02af609bfd4e">
Nov 27 04:46:00 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:46:00 user nova-compute[75260]:         </nova:port>
Nov 27 04:46:00 user nova-compute[75260]:       </nova:ports>
Nov 27 04:46:00 user nova-compute[75260]:     </nova:instance>
Nov 27 04:46:00 user nova-compute[75260]:   </metadata>
Nov 27 04:46:00 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:46:00 user nova-compute[75260]:     <system>
Nov 27 04:46:00 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:46:00 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:46:00 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:46:00 user nova-compute[75260]:       <entry name="serial">57ee8ff0-df13-4f15-96a0-c324b10dd9a7</entry>
Nov 27 04:46:00 user nova-compute[75260]:       <entry name="uuid">57ee8ff0-df13-4f15-96a0-c324b10dd9a7</entry>
Nov 27 04:46:00 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:46:00 user nova-compute[75260]:     </system>
Nov 27 04:46:00 user nova-compute[75260]:   </sysinfo>
Nov 27 04:46:00 user nova-compute[75260]:   <os>
Nov 27 04:46:00 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:46:00 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:46:00 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:46:00 user nova-compute[75260]:   </os>
Nov 27 04:46:00 user nova-compute[75260]:   <features>
Nov 27 04:46:00 user nova-compute[75260]:     <acpi/>
Nov 27 04:46:00 user nova-compute[75260]:     <apic/>
Nov 27 04:46:00 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:46:00 user nova-compute[75260]:   </features>
Nov 27 04:46:00 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:46:00 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:46:00 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:46:00 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:46:00 user nova-compute[75260]:   </clock>
Nov 27 04:46:00 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:46:00 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:46:00 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:46:00 user nova-compute[75260]:   </cpu>
Nov 27 04:46:00 user nova-compute[75260]:   <devices>
Nov 27 04:46:00 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:46:00 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:46:00 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk"/>
Nov 27 04:46:00 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:46:00 user nova-compute[75260]:     </disk>
Nov 27 04:46:00 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:46:00 user nova-compute[75260]:       <mac address="fa:16:3e:68:c8:81"/>
Nov 27 04:46:00 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:46:00 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:46:00 user nova-compute[75260]:       <target dev="tap08fcec14-f1"/>
Nov 27 04:46:00 user nova-compute[75260]:     </interface>
Nov 27 04:46:00 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:46:00 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/console.log" append="off"/>
Nov 27 04:46:00 user nova-compute[75260]:     </serial>
Nov 27 04:46:00 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:46:00 user nova-compute[75260]:     <video>
Nov 27 04:46:00 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:46:00 user nova-compute[75260]:     </video>
Nov 27 04:46:00 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:46:00 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:46:00 user nova-compute[75260]:     </rng>
Nov 27 04:46:00 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:46:00 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:46:00 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:46:00 user nova-compute[75260]:     </memballoon>
Nov 27 04:46:00 user nova-compute[75260]:   </devices>
Nov 27 04:46:00 user nova-compute[75260]: </domain>
Nov 27 04:46:00 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1343339764',display_name='tempest-ServerStableDeviceRescueTest-server-1343339764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1343339764',id=23,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTQN+/2CjAEBmT4+S+1zo64Z0W5v1lvMJnT95nxxyeuCKn1YzWu5h2Sgpil050tma7PbOyqmOUnEFI32sPfr1Lq9oY/oSHuA9d3TuhQeiSZENua0tyJQOXqlfYvzCbiAw==',key_name='tempest-keypair-817121387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efcdc0a7701245aaae5d18694ec3e0e4',ramdisk_id='',reservation_id='r-1j1jr746',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1298117882',owner_user_name='tempest-ServerStableDeviceRescueTest-1298117882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbc381d6509448db6f2b23ec2a609d2',uuid=57ee8ff0-df13-4f15-96a0-c324b10dd9a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Converting VIF {"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:c8:81,bridge_name='br-int',has_traffic_filtering=True,id=08fcec14-f146-4deb-861b-02af609bfd4e,network=Network(eaa843ad-ee5c-45a7-ad9f-103049904426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fcec14-f1') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG os_vif [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:c8:81,bridge_name='br-int',has_traffic_filtering=True,id=08fcec14-f146-4deb-861b-02af609bfd4e,network=Network(eaa843ad-ee5c-45a7-ad9f-103049904426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fcec14-f1') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '372a527f-3911-5a98-b69c-d4215f583528', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08fcec14-f1, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08fcec14-f1, col_values=(('qos', UUID('d49e48eb-1a01-4b8b-aaa8-3d4f89ee476a')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08fcec14-f1, col_values=(('external_ids', {'iface-id': '08fcec14-f146-4deb-861b-02af609bfd4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:c8:81', 'vm-uuid': '57ee8ff0-df13-4f15-96a0-c324b10dd9a7'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:00 user nova-compute[75260]: INFO os_vif [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:c8:81,bridge_name='br-int',has_traffic_filtering=True,id=08fcec14-f146-4deb-861b-02af609bfd4e,network=Network(eaa843ad-ee5c-45a7-ad9f-103049904426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fcec14-f1')
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:46:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] No VIF found with MAC fa:16:3e:68:c8:81, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:46:01 user nova-compute[75260]: DEBUG nova.network.neutron [req-c239bc79-786b-41c9-9009-448c80fe3908 req-0618c29b-922d-4afa-8c4f-07b5ff20f493 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updated VIF entry in instance network info cache for port 08fcec14-f146-4deb-861b-02af609bfd4e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:46:01 user nova-compute[75260]: DEBUG nova.network.neutron [req-c239bc79-786b-41c9-9009-448c80fe3908 req-0618c29b-922d-4afa-8c4f-07b5ff20f493 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updating instance_info_cache with network_info: [{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c239bc79-786b-41c9-9009-448c80fe3908 req-0618c29b-922d-4afa-8c4f-07b5ff20f493 service nova] Releasing lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:46:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-a14d4d4e-ec6a-41ba-a4e0-faa9d91c9299 req-bf471a68-5bc5-4241-97f5-6eaa91418d63 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a14d4d4e-ec6a-41ba-a4e0-faa9d91c9299 req-bf471a68-5bc5-4241-97f5-6eaa91418d63 service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a14d4d4e-ec6a-41ba-a4e0-faa9d91c9299 req-bf471a68-5bc5-4241-97f5-6eaa91418d63 service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a14d4d4e-ec6a-41ba-a4e0-faa9d91c9299 req-bf471a68-5bc5-4241-97f5-6eaa91418d63 service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-a14d4d4e-ec6a-41ba-a4e0-faa9d91c9299 req-bf471a68-5bc5-4241-97f5-6eaa91418d63 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:02 user nova-compute[75260]: WARNING nova.compute.manager [req-a14d4d4e-ec6a-41ba-a4e0-faa9d91c9299 req-bf471a68-5bc5-4241-97f5-6eaa91418d63 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state building and task_state spawning.
Nov 27 04:46:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:46:04 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Instance spawned successfully.
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:04 user nova-compute[75260]: INFO nova.compute.manager [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-2e9452d7-f47f-4cb0-b9a8-19e2b9ed920c req-8f852054-9489-4bc6-8ee4-3a12419aa44e service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2e9452d7-f47f-4cb0-b9a8-19e2b9ed920c req-8f852054-9489-4bc6-8ee4-3a12419aa44e service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2e9452d7-f47f-4cb0-b9a8-19e2b9ed920c req-8f852054-9489-4bc6-8ee4-3a12419aa44e service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2e9452d7-f47f-4cb0-b9a8-19e2b9ed920c req-8f852054-9489-4bc6-8ee4-3a12419aa44e service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-2e9452d7-f47f-4cb0-b9a8-19e2b9ed920c req-8f852054-9489-4bc6-8ee4-3a12419aa44e service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:04 user nova-compute[75260]: WARNING nova.compute.manager [req-2e9452d7-f47f-4cb0-b9a8-19e2b9ed920c req-8f852054-9489-4bc6-8ee4-3a12419aa44e service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state building and task_state spawning.
Nov 27 04:46:04 user nova-compute[75260]: INFO nova.compute.manager [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Took 6.29 seconds to build instance.
Nov 27 04:46:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0bb77126-2579-456f-b59e-10a6fdf31683 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.382s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG nova.compute.manager [req-e10dd812-f6d5-4636-869f-2fbd18e9ca4c req-f814044d-da1e-4f36-afbe-bc51a05b9d4f service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-changed-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG nova.compute.manager [req-e10dd812-f6d5-4636-869f-2fbd18e9ca4c req-f814044d-da1e-4f36-afbe-bc51a05b9d4f service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Refreshing instance network info cache due to event network-changed-376192b1-f789-4b6f-be27-55efeb202f27. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e10dd812-f6d5-4636-869f-2fbd18e9ca4c req-f814044d-da1e-4f36-afbe-bc51a05b9d4f service nova] Acquiring lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e10dd812-f6d5-4636-869f-2fbd18e9ca4c req-f814044d-da1e-4f36-afbe-bc51a05b9d4f service nova] Acquired lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG nova.network.neutron [req-e10dd812-f6d5-4636-869f-2fbd18e9ca4c req-f814044d-da1e-4f36-afbe-bc51a05b9d4f service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Refreshing network info cache for port 376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "interface-1100294c-ea5b-4994-885d-47357e7802c5-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "interface-1100294c-ea5b-4994-885d-47357e7802c5-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG nova.objects.instance [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lazy-loading 'flavor' on Instance uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG nova.network.neutron [req-e10dd812-f6d5-4636-869f-2fbd18e9ca4c req-f814044d-da1e-4f36-afbe-bc51a05b9d4f service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updated VIF entry in instance network info cache for port 376192b1-f789-4b6f-be27-55efeb202f27. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG nova.network.neutron [req-e10dd812-f6d5-4636-869f-2fbd18e9ca4c req-f814044d-da1e-4f36-afbe-bc51a05b9d4f service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updating instance_info_cache with network_info: [{"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e10dd812-f6d5-4636-869f-2fbd18e9ca4c req-f814044d-da1e-4f36-afbe-bc51a05b9d4f service nova] Releasing lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG nova.objects.instance [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lazy-loading 'pci_requests' on Instance uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG nova.objects.base [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Object Instance<1100294c-ea5b-4994-885d-47357e7802c5> lazy-loaded attributes: flavor,pci_requests {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG nova.policy [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a463d6bb05e471c9dfaf686d06202e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d9acefde97437abee0beaae079fcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:46:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:14 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Successfully created port: 45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Successfully updated port: 45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquired lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-becbdd98-924e-4735-864b-8b45f4281402 req-f806a8b9-ae8c-4667-87a5-c7cf341051a0 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-changed-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-becbdd98-924e-4735-864b-8b45f4281402 req-f806a8b9-ae8c-4667-87a5-c7cf341051a0 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Refreshing instance network info cache due to event network-changed-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-becbdd98-924e-4735-864b-8b45f4281402 req-f806a8b9-ae8c-4667-87a5-c7cf341051a0 service nova] Acquiring lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updating instance_info_cache with network_info: [{"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Releasing lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-becbdd98-924e-4735-864b-8b45f4281402 req-f806a8b9-ae8c-4667-87a5-c7cf341051a0 service nova] Acquired lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.network.neutron [req-becbdd98-924e-4735-864b-8b45f4281402 req-f806a8b9-ae8c-4667-87a5-c7cf341051a0 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Refreshing network info cache for port 45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717557176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717557176',id=18,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW/qZPhLS1C8EQqzaoylt+DfXolIsqNuC0floaWTwm9Y8Kc2f0NOU/7QWq7h0reHBPBKp0h7iYnCXj4HbSmbHm1/Ah0OwOQu0068/YZcZc3v7umKCkKAxw0WIQGACGtqg==',key_name='tempest-keypair-875505160',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3d9acefde97437abee0beaae079fcd9',ramdisk_id='',reservation_id='r-sco77w29',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-682424273',owner_user_name='tempest-TaggedAttachmentsTest-682424273-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a463d6bb05e471c9dfaf686d06202e1',uuid=1100294c-ea5b-4994-885d-47357e7802c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converting VIF {"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG os_vif [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4d9cdbc-6d37-51a3-b23f-d5411ecff055', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45b06fa0-87, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45b06fa0-87, col_values=(('qos', UUID('9dbebff0-2e96-47b5-b274-b359d882b45f')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45b06fa0-87, col_values=(('external_ids', {'iface-id': '45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:89:a3', 'vm-uuid': '1100294c-ea5b-4994-885d-47357e7802c5'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:15 user nova-compute[75260]: INFO os_vif [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87')
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717557176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717557176',id=18,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW/qZPhLS1C8EQqzaoylt+DfXolIsqNuC0floaWTwm9Y8Kc2f0NOU/7QWq7h0reHBPBKp0h7iYnCXj4HbSmbHm1/Ah0OwOQu0068/YZcZc3v7umKCkKAxw0WIQGACGtqg==',key_name='tempest-keypair-875505160',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3d9acefde97437abee0beaae079fcd9',ramdisk_id='',reservation_id='r-sco77w29',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-682424273',owner_user_name='tempest-TaggedAttachmentsTest-682424273-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a463d6bb05e471c9dfaf686d06202e1',uuid=1100294c-ea5b-4994-885d-47357e7802c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converting VIF {"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] attach device xml: <interface type="ethernet">
Nov 27 04:46:15 user nova-compute[75260]:   <mac address="fa:16:3e:b1:89:a3"/>
Nov 27 04:46:15 user nova-compute[75260]:   <model type="virtio"/>
Nov 27 04:46:15 user nova-compute[75260]:   <mtu size="1442"/>
Nov 27 04:46:15 user nova-compute[75260]:   <target dev="tap45b06fa0-87"/>
Nov 27 04:46:15 user nova-compute[75260]: </interface>
Nov 27 04:46:15 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:46:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-2c4f121f-9e10-473d-9568-844b41dee203 req-0619b6cd-ee45-463f-b537-7956388eae8b service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-plugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2c4f121f-9e10-473d-9568-844b41dee203 req-0619b6cd-ee45-463f-b537-7956388eae8b service nova] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2c4f121f-9e10-473d-9568-844b41dee203 req-0619b6cd-ee45-463f-b537-7956388eae8b service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2c4f121f-9e10-473d-9568-844b41dee203 req-0619b6cd-ee45-463f-b537-7956388eae8b service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-2c4f121f-9e10-473d-9568-844b41dee203 req-0619b6cd-ee45-463f-b537-7956388eae8b service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] No waiting events found dispatching network-vif-plugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:16 user nova-compute[75260]: WARNING nova.compute.manager [req-2c4f121f-9e10-473d-9568-844b41dee203 req-0619b6cd-ee45-463f-b537-7956388eae8b service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received unexpected event network-vif-plugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e for instance with vm_state active and task_state None.
Nov 27 04:46:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] No BDM found with device name hda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] No VIF found with MAC fa:16:3e:81:d6:58, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:46:16 user nova-compute[75260]:   <nova:package version="0.0.0"/>
Nov 27 04:46:16 user nova-compute[75260]:   <nova:name>tempest-device-tagging-server-717557176</nova:name>
Nov 27 04:46:16 user nova-compute[75260]:   <nova:creationTime>2023-11-27 04:46:16</nova:creationTime>
Nov 27 04:46:16 user nova-compute[75260]:   <nova:flavor name="m1.tiny">
Nov 27 04:46:16 user nova-compute[75260]:     <nova:memory>512</nova:memory>
Nov 27 04:46:16 user nova-compute[75260]:     <nova:disk>1</nova:disk>
Nov 27 04:46:16 user nova-compute[75260]:     <nova:swap>0</nova:swap>
Nov 27 04:46:16 user nova-compute[75260]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:46:16 user nova-compute[75260]:     <nova:vcpus>1</nova:vcpus>
Nov 27 04:46:16 user nova-compute[75260]:   </nova:flavor>
Nov 27 04:46:16 user nova-compute[75260]:   <nova:owner>
Nov 27 04:46:16 user nova-compute[75260]:     <nova:user uuid="8a463d6bb05e471c9dfaf686d06202e1">tempest-TaggedAttachmentsTest-682424273-project-member</nova:user>
Nov 27 04:46:16 user nova-compute[75260]:     <nova:project uuid="a3d9acefde97437abee0beaae079fcd9">tempest-TaggedAttachmentsTest-682424273</nova:project>
Nov 27 04:46:16 user nova-compute[75260]:   </nova:owner>
Nov 27 04:46:16 user nova-compute[75260]:   <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:46:16 user nova-compute[75260]:   <nova:ports>
Nov 27 04:46:16 user nova-compute[75260]:     <nova:port uuid="376192b1-f789-4b6f-be27-55efeb202f27">
Nov 27 04:46:16 user nova-compute[75260]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:46:16 user nova-compute[75260]:     </nova:port>
Nov 27 04:46:16 user nova-compute[75260]:     <nova:port uuid="45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e">
Nov 27 04:46:16 user nova-compute[75260]:       <nova:ip type="fixed" address="10.10.10.180" ipVersion="4"/>
Nov 27 04:46:16 user nova-compute[75260]:     </nova:port>
Nov 27 04:46:16 user nova-compute[75260]:   </nova:ports>
Nov 27 04:46:16 user nova-compute[75260]: </nova:instance>
Nov 27 04:46:16 user nova-compute[75260]:  {{(pid=75260) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0f83ca33-3717-4951-92ed-57c822301eb5 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "interface-1100294c-ea5b-4994-885d-47357e7802c5-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.866s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG nova.network.neutron [req-becbdd98-924e-4735-864b-8b45f4281402 req-f806a8b9-ae8c-4667-87a5-c7cf341051a0 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updated VIF entry in instance network info cache for port 45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG nova.network.neutron [req-becbdd98-924e-4735-864b-8b45f4281402 req-f806a8b9-ae8c-4667-87a5-c7cf341051a0 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updating instance_info_cache with network_info: [{"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-becbdd98-924e-4735-864b-8b45f4281402 req-f806a8b9-ae8c-4667-87a5-c7cf341051a0 service nova] Releasing lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG nova.objects.instance [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lazy-loading 'flavor' on Instance uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:17 user nova-compute[75260]: INFO nova.compute.manager [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Attaching volume dd3ad552-85b0-4f5f-8ea4-131c47e256b8 to /dev/vdb
Nov 27 04:46:17 user nova-compute[75260]: DEBUG os_brick.utils [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce45fbb-6003-4db3-ab30-9adbc275749b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[175e4c8d-d0a5-4363-8efe-52bb4a988c6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ff73c0-858b-45a1-96c8-6edb108cb13a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a6ed77-40d9-4d06-a7ac-c427f5365059]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:46:17 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:46:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b543fd-2a97-4f3c-b3fa-bd6320c59b66]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG os_brick.utils [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:46:17 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updating existing volume attachment record: 155d6c88-1658-427d-96fe-71fe6d17867c {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:46:18 user nova-compute[75260]: DEBUG nova.compute.manager [req-d1c580ec-6bb0-4398-8793-0d7f3c44e456 req-4e99e102-257c-4801-a7ae-6789fd08b27b service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-plugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d1c580ec-6bb0-4398-8793-0d7f3c44e456 req-4e99e102-257c-4801-a7ae-6789fd08b27b service nova] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d1c580ec-6bb0-4398-8793-0d7f3c44e456 req-4e99e102-257c-4801-a7ae-6789fd08b27b service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d1c580ec-6bb0-4398-8793-0d7f3c44e456 req-4e99e102-257c-4801-a7ae-6789fd08b27b service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:18 user nova-compute[75260]: DEBUG nova.compute.manager [req-d1c580ec-6bb0-4398-8793-0d7f3c44e456 req-4e99e102-257c-4801-a7ae-6789fd08b27b service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] No waiting events found dispatching network-vif-plugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:18 user nova-compute[75260]: WARNING nova.compute.manager [req-d1c580ec-6bb0-4398-8793-0d7f3c44e456 req-4e99e102-257c-4801-a7ae-6789fd08b27b service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received unexpected event network-vif-plugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e for instance with vm_state active and task_state None.
Nov 27 04:46:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:46:19 user nova-compute[75260]: INFO nova.compute.claims [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Claim successful on node user
Nov 27 04:46:19 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:46:19 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:46:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:46:19 user nova-compute[75260]: DEBUG nova.policy [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71baa1a857c5458ea2d03515ea2ccaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a344ddbabc8e48e9987d8aa73042821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:46:20 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Creating image(s)
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "/opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "/opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk 1073741824" returned: 0 in 0.046s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.195s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Successfully created port: 4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Cannot resize image /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Ensure instance console log exists: /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Successfully updated port: 4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquired lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-bcf3c108-97e4-415d-94e9-4242af60a41e req-3a59e247-113a-4def-aa5e-686e53d2f6fd service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received event network-changed-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-bcf3c108-97e4-415d-94e9-4242af60a41e req-3a59e247-113a-4def-aa5e-686e53d2f6fd service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Refreshing instance network info cache due to event network-changed-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bcf3c108-97e4-415d-94e9-4242af60a41e req-3a59e247-113a-4def-aa5e-686e53d2f6fd service nova] Acquiring lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updating instance_info_cache with network_info: [{"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Releasing lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Instance network_info: |[{"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bcf3c108-97e4-415d-94e9-4242af60a41e req-3a59e247-113a-4def-aa5e-686e53d2f6fd service nova] Acquired lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.network.neutron [req-bcf3c108-97e4-415d-94e9-4242af60a41e req-3a59e247-113a-4def-aa5e-686e53d2f6fd service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Refreshing network info cache for port 4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Start _get_guest_xml network_info=[{"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:46:21 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:46:21 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1019194683',display_name='tempest-ServerActionsTestOtherA-server-1019194683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1019194683',id=24,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOij+0g1QbUNojcJl3yIM3Tv96IeOdvkNKm5ThbXwXoQhcjwE76rap7fFhOUAjRiN20jCHkXP7XPhGl+HzdyShkrkNHzkMrulgl7gxlMCqAAOAl9YSxm9bSuYOmPOCmkIw==',key_name='tempest-keypair-1643056830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-cjyd2qz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=4fe8daac-ecc6-4b5c-99d6-b651e3c37e82,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8daac-ec') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.objects.instance [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:46:21 user nova-compute[75260]:   <uuid>3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf</uuid>
Nov 27 04:46:21 user nova-compute[75260]:   <name>instance-00000018</name>
Nov 27 04:46:21 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:46:21 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:46:21 user nova-compute[75260]:   <metadata>
Nov 27 04:46:21 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:46:21 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:46:21 user nova-compute[75260]:       <nova:name>tempest-ServerActionsTestOtherA-server-1019194683</nova:name>
Nov 27 04:46:21 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:46:21</nova:creationTime>
Nov 27 04:46:21 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:46:21 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:46:21 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:46:21 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:46:21 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:46:21 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:46:21 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:46:21 user nova-compute[75260]:       <nova:owner>
Nov 27 04:46:21 user nova-compute[75260]:         <nova:user uuid="71baa1a857c5458ea2d03515ea2ccaf3">tempest-ServerActionsTestOtherA-678795315-project-member</nova:user>
Nov 27 04:46:21 user nova-compute[75260]:         <nova:project uuid="a344ddbabc8e48e9987d8aa73042821a">tempest-ServerActionsTestOtherA-678795315</nova:project>
Nov 27 04:46:21 user nova-compute[75260]:       </nova:owner>
Nov 27 04:46:21 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:46:21 user nova-compute[75260]:       <nova:ports>
Nov 27 04:46:21 user nova-compute[75260]:         <nova:port uuid="4fe8daac-ecc6-4b5c-99d6-b651e3c37e82">
Nov 27 04:46:21 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 04:46:21 user nova-compute[75260]:         </nova:port>
Nov 27 04:46:21 user nova-compute[75260]:       </nova:ports>
Nov 27 04:46:21 user nova-compute[75260]:     </nova:instance>
Nov 27 04:46:21 user nova-compute[75260]:   </metadata>
Nov 27 04:46:21 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:46:21 user nova-compute[75260]:     <system>
Nov 27 04:46:21 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:46:21 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:46:21 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:46:21 user nova-compute[75260]:       <entry name="serial">3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf</entry>
Nov 27 04:46:21 user nova-compute[75260]:       <entry name="uuid">3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf</entry>
Nov 27 04:46:21 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:46:21 user nova-compute[75260]:     </system>
Nov 27 04:46:21 user nova-compute[75260]:   </sysinfo>
Nov 27 04:46:21 user nova-compute[75260]:   <os>
Nov 27 04:46:21 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:46:21 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:46:21 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:46:21 user nova-compute[75260]:   </os>
Nov 27 04:46:21 user nova-compute[75260]:   <features>
Nov 27 04:46:21 user nova-compute[75260]:     <acpi/>
Nov 27 04:46:21 user nova-compute[75260]:     <apic/>
Nov 27 04:46:21 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:46:21 user nova-compute[75260]:   </features>
Nov 27 04:46:21 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:46:21 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:46:21 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:46:21 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:46:21 user nova-compute[75260]:   </clock>
Nov 27 04:46:21 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:46:21 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:46:21 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:46:21 user nova-compute[75260]:   </cpu>
Nov 27 04:46:21 user nova-compute[75260]:   <devices>
Nov 27 04:46:21 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:46:21 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:46:21 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk"/>
Nov 27 04:46:21 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:46:21 user nova-compute[75260]:     </disk>
Nov 27 04:46:21 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:46:21 user nova-compute[75260]:       <mac address="fa:16:3e:7d:50:d8"/>
Nov 27 04:46:21 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:46:21 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:46:21 user nova-compute[75260]:       <target dev="tap4fe8daac-ec"/>
Nov 27 04:46:21 user nova-compute[75260]:     </interface>
Nov 27 04:46:21 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:46:21 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/console.log" append="off"/>
Nov 27 04:46:21 user nova-compute[75260]:     </serial>
Nov 27 04:46:21 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:46:21 user nova-compute[75260]:     <video>
Nov 27 04:46:21 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:46:21 user nova-compute[75260]:     </video>
Nov 27 04:46:21 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:46:21 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:46:21 user nova-compute[75260]:     </rng>
Nov 27 04:46:21 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:46:21 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:46:21 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:46:21 user nova-compute[75260]:     </memballoon>
Nov 27 04:46:21 user nova-compute[75260]:   </devices>
Nov 27 04:46:21 user nova-compute[75260]: </domain>
Nov 27 04:46:21 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1019194683',display_name='tempest-ServerActionsTestOtherA-server-1019194683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1019194683',id=24,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOij+0g1QbUNojcJl3yIM3Tv96IeOdvkNKm5ThbXwXoQhcjwE76rap7fFhOUAjRiN20jCHkXP7XPhGl+HzdyShkrkNHzkMrulgl7gxlMCqAAOAl9YSxm9bSuYOmPOCmkIw==',key_name='tempest-keypair-1643056830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-cjyd2qz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=4fe8daac-ecc6-4b5c-99d6-b651e3c37e82,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8daac-ec') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG os_vif [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=4fe8daac-ecc6-4b5c-99d6-b651e3c37e82,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8daac-ec') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d0ad490-3d64-5c39-ae05-0e8d72b97451', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fe8daac-ec, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fe8daac-ec, col_values=(('qos', UUID('360fa416-cdd0-4e75-b8d4-2698333e8444')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fe8daac-ec, col_values=(('external_ids', {'iface-id': '4fe8daac-ecc6-4b5c-99d6-b651e3c37e82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:50:d8', 'vm-uuid': '3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:22 user nova-compute[75260]: INFO os_vif [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=4fe8daac-ecc6-4b5c-99d6-b651e3c37e82,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8daac-ec')
Nov 27 04:46:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:46:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No VIF found with MAC fa:16:3e:7d:50:d8, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:46:22 user nova-compute[75260]: DEBUG nova.network.neutron [req-bcf3c108-97e4-415d-94e9-4242af60a41e req-3a59e247-113a-4def-aa5e-686e53d2f6fd service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updated VIF entry in instance network info cache for port 4fe8daac-ecc6-4b5c-99d6-b651e3c37e82. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:46:22 user nova-compute[75260]: DEBUG nova.network.neutron [req-bcf3c108-97e4-415d-94e9-4242af60a41e req-3a59e247-113a-4def-aa5e-686e53d2f6fd service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updating instance_info_cache with network_info: [{"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bcf3c108-97e4-415d-94e9-4242af60a41e req-3a59e247-113a-4def-aa5e-686e53d2f6fd service nova] Releasing lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpEzLkPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:46:23 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:46:23 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:46:23 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[17592e2e-3084-4611-af21-6c8d5e3d4e3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:46:23 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[716ff80c-facf-4c55-bf19-c9d6c5b9b47f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8] added
Nov 27 04:46:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4129a360-2744-4d02-a63b-e8fbe8387d88]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG nova.compute.manager [req-6b068303-79b7-447d-810a-44a9d3949a55 req-90101bd2-6a31-4710-be2d-6bcbb2e5d86e service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received event network-vif-plugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6b068303-79b7-447d-810a-44a9d3949a55 req-90101bd2-6a31-4710-be2d-6bcbb2e5d86e service nova] Acquiring lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6b068303-79b7-447d-810a-44a9d3949a55 req-90101bd2-6a31-4710-be2d-6bcbb2e5d86e service nova] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6b068303-79b7-447d-810a-44a9d3949a55 req-90101bd2-6a31-4710-be2d-6bcbb2e5d86e service nova] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG nova.compute.manager [req-6b068303-79b7-447d-810a-44a9d3949a55 req-90101bd2-6a31-4710-be2d-6bcbb2e5d86e service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] No waiting events found dispatching network-vif-plugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:23 user nova-compute[75260]: WARNING nova.compute.manager [req-6b068303-79b7-447d-810a-44a9d3949a55 req-90101bd2-6a31-4710-be2d-6bcbb2e5d86e service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received unexpected event network-vif-plugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 for instance with vm_state building and task_state spawning.
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a50b27-4fc2-46d9-8720-d311cdf77dd3]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UpEzLkPa {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UpEzLkPa" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e366914-d787-466c-8122-56267efac7f0]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UpEzLkPa'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[64db664d-61b3-4d78-b861-c19b4dc180ff]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbac990c-372a-456e-b017-6d0b51e72706]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:46:24 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:46:24 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6418cb24-09a3-4b13-822e-acf4901e19c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8, portal: 172.16.0.220,3260]
Nov 27 04:46:24 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8, portal: 172.16.0.220,3260] successful.
Nov 27 04:46:24 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5fee5e-c7e5-415a-ae6c-c92e838d879a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d68b50-c61b-413e-b45d-40e0bb05aa5c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:46:24 user nova-compute[75260]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)
Nov 27 04:46:24 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:46:24 user nova-compute[75260]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)
Nov 27 04:46:24 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.040s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b37827-8e6d-4a7e-a303-2b3782c4969e]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpEzLkPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '26133396639353530', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133396639353530', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.objects.instance [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lazy-loading 'flavor' on Instance uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:46:25 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:46:25 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:46:25 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:46:25 user nova-compute[75260]:   <serial>dd3ad552-85b0-4f5f-8ea4-131c47e256b8</serial>
Nov 27 04:46:25 user nova-compute[75260]: </disk>
Nov 27 04:46:25 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] No BDM found with device name hda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] No VIF found with MAC fa:16:3e:81:d6:58, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20438d46-1d6d-426d-8855-ae492e4135d1 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.757s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:46:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Instance spawned successfully.
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-700cb27a-d9b5-4b27-8f3f-563fb3c6b4ce req-35aed2bc-7d2b-4db1-8455-dcbe404790a5 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received event network-vif-plugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-700cb27a-d9b5-4b27-8f3f-563fb3c6b4ce req-35aed2bc-7d2b-4db1-8455-dcbe404790a5 service nova] Acquiring lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-700cb27a-d9b5-4b27-8f3f-563fb3c6b4ce req-35aed2bc-7d2b-4db1-8455-dcbe404790a5 service nova] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-700cb27a-d9b5-4b27-8f3f-563fb3c6b4ce req-35aed2bc-7d2b-4db1-8455-dcbe404790a5 service nova] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-700cb27a-d9b5-4b27-8f3f-563fb3c6b4ce req-35aed2bc-7d2b-4db1-8455-dcbe404790a5 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] No waiting events found dispatching network-vif-plugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:25 user nova-compute[75260]: WARNING nova.compute.manager [req-700cb27a-d9b5-4b27-8f3f-563fb3c6b4ce req-35aed2bc-7d2b-4db1-8455-dcbe404790a5 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received unexpected event network-vif-plugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 for instance with vm_state building and task_state spawning.
Nov 27 04:46:25 user nova-compute[75260]: INFO nova.compute.manager [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 27 04:46:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:46:26 user nova-compute[75260]: INFO nova.compute.manager [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Took 6.81 seconds to build instance.
Nov 27 04:46:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a6df520-7008-4171-a78a-51941d9754d4 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.914s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Acquiring lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Acquiring lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:26 user nova-compute[75260]: INFO nova.compute.manager [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Terminating instance
Nov 27 04:46:26 user nova-compute[75260]: DEBUG nova.compute.manager [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-244101e3-a909-4fe6-af0d-44f36f763388 req-2709a226-f416-4eb0-ab49-d8e76f7d431a service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Received event network-vif-unplugged-67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-244101e3-a909-4fe6-af0d-44f36f763388 req-2709a226-f416-4eb0-ab49-d8e76f7d431a service nova] Acquiring lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-244101e3-a909-4fe6-af0d-44f36f763388 req-2709a226-f416-4eb0-ab49-d8e76f7d431a service nova] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-244101e3-a909-4fe6-af0d-44f36f763388 req-2709a226-f416-4eb0-ab49-d8e76f7d431a service nova] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-244101e3-a909-4fe6-af0d-44f36f763388 req-2709a226-f416-4eb0-ab49-d8e76f7d431a service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] No waiting events found dispatching network-vif-unplugged-67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-244101e3-a909-4fe6-af0d-44f36f763388 req-2709a226-f416-4eb0-ab49-d8e76f7d431a service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Received event network-vif-unplugged-67f86621-ca29-450f-9ddb-fd190c64d61e for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:27 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Instance destroyed successfully.
Nov 27 04:46:27 user nova-compute[75260]: DEBUG nova.objects.instance [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lazy-loading 'resources' on Instance uuid a13858fb-12db-4dc9-9c43-b24b1f222d9b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1822769571',display_name='tempest-VolumesActionsTest-instance-1822769571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1822769571',id=19,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:44:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97394fe74bf6412fbc561c1f7dad4af0',ramdisk_id='',reservation_id='r-oiis0802',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-54512603',owner_user_name='tempest-VolumesActionsTest-54512603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:37Z,user_data=None,user_id='bfdea97aebe645018321c9c7ca211c8c',uuid=a13858fb-12db-4dc9-9c43-b24b1f222d9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67f86621-ca29-450f-9ddb-fd190c64d61e", "address": "fa:16:3e:1a:2c:83", "network": {"id": "7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1451672524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97394fe74bf6412fbc561c1f7dad4af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f86621-ca", "ovs_interfaceid": "67f86621-ca29-450f-9ddb-fd190c64d61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Converting VIF {"id": "67f86621-ca29-450f-9ddb-fd190c64d61e", "address": "fa:16:3e:1a:2c:83", "network": {"id": "7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1451672524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97394fe74bf6412fbc561c1f7dad4af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f86621-ca", "ovs_interfaceid": "67f86621-ca29-450f-9ddb-fd190c64d61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:83,bridge_name='br-int',has_traffic_filtering=True,id=67f86621-ca29-450f-9ddb-fd190c64d61e,network=Network(7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f86621-ca') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG os_vif [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:83,bridge_name='br-int',has_traffic_filtering=True,id=67f86621-ca29-450f-9ddb-fd190c64d61e,network=Network(7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f86621-ca') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67f86621-ca, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d220962f-a669-4337-9885-d54cb4ca84d0) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:27 user nova-compute[75260]: INFO os_vif [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2c:83,bridge_name='br-int',has_traffic_filtering=True,id=67f86621-ca29-450f-9ddb-fd190c64d61e,network=Network(7ef57c13-da1d-4e09-8dc5-fe7cacd6d08a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f86621-ca')
Nov 27 04:46:27 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Deleting instance files /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b_del
Nov 27 04:46:27 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Deletion of /opt/stack/data/nova/instances/a13858fb-12db-4dc9-9c43-b24b1f222d9b_del complete
Nov 27 04:46:27 user nova-compute[75260]: INFO nova.compute.manager [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 27 04:46:27 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:46:27 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-af1ce655-eb96-4ac5-b60a-4d7280023955 req-b1e53752-52d3-410c-963e-4ea038e1bad1 service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Received event network-vif-deleted-67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:28 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Took 0.70 seconds to deallocate network for instance.
Nov 27 04:46:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:28 user nova-compute[75260]: INFO nova.compute.manager [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Detaching volume dd3ad552-85b0-4f5f-8ea4-131c47e256b8
Nov 27 04:46:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:28 user nova-compute[75260]: INFO nova.virt.block_device [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Attempting to driver detach volume dd3ad552-85b0-4f5f-8ea4-131c47e256b8 from mountpoint /dev/vdb
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Attempting to detach device vdb from instance 1100294c-ea5b-4994-885d-47357e7802c5 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:46:28 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:46:28 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:46:28 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:46:28 user nova-compute[75260]:   <serial>dd3ad552-85b0-4f5f-8ea4-131c47e256b8</serial>
Nov 27 04:46:28 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 04:46:28 user nova-compute[75260]: </disk>
Nov 27 04:46:28 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:46:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Successfully detached device vdb from instance 1100294c-ea5b-4994-885d-47357e7802c5 from the persistent domain config.
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1100294c-ea5b-4994-885d-47357e7802c5 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:46:28 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:46:28 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:46:28 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:46:28 user nova-compute[75260]:   <serial>dd3ad552-85b0-4f5f-8ea4-131c47e256b8</serial>
Nov 27 04:46:28 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 04:46:28 user nova-compute[75260]: </disk>
Nov 27 04:46:28 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:28 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Deleted allocations for instance a13858fb-12db-4dc9-9c43-b24b1f222d9b
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-20b61625-1547-4d76-ad9a-bca02138c8ef tempest-VolumesActionsTest-54512603 tempest-VolumesActionsTest-54512603-project-member] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-da7255d2-1799-4dba-a1c6-9ef8645c40d2 req-885dd73f-77c5-420d-b254-826d08dd0daf service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Received event network-vif-plugged-67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-da7255d2-1799-4dba-a1c6-9ef8645c40d2 req-885dd73f-77c5-420d-b254-826d08dd0daf service nova] Acquiring lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-da7255d2-1799-4dba-a1c6-9ef8645c40d2 req-885dd73f-77c5-420d-b254-826d08dd0daf service nova] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-da7255d2-1799-4dba-a1c6-9ef8645c40d2 req-885dd73f-77c5-420d-b254-826d08dd0daf service nova] Lock "a13858fb-12db-4dc9-9c43-b24b1f222d9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-da7255d2-1799-4dba-a1c6-9ef8645c40d2 req-885dd73f-77c5-420d-b254-826d08dd0daf service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] No waiting events found dispatching network-vif-plugged-67f86621-ca29-450f-9ddb-fd190c64d61e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:28 user nova-compute[75260]: WARNING nova.compute.manager [req-da7255d2-1799-4dba-a1c6-9ef8645c40d2 req-885dd73f-77c5-420d-b254-826d08dd0daf service nova] [instance: a13858fb-12db-4dc9-9c43-b24b1f222d9b] Received unexpected event network-vif-plugged-67f86621-ca29-450f-9ddb-fd190c64d61e for instance with vm_state deleted and task_state None.
Nov 27 04:46:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-2a62d563-7bd2-4f4a-918c-0ca09492ebc5 req-8e9c31f2-18d6-47e6-b733-8fe2b7b46d66 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received event network-changed-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-2a62d563-7bd2-4f4a-918c-0ca09492ebc5 req-8e9c31f2-18d6-47e6-b733-8fe2b7b46d66 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Refreshing instance network info cache due to event network-changed-616206c9-3674-4232-a547-4442283b73ad. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:46:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2a62d563-7bd2-4f4a-918c-0ca09492ebc5 req-8e9c31f2-18d6-47e6-b733-8fe2b7b46d66 service nova] Acquiring lock "refresh_cache-27a9c97c-e6f7-492a-808e-d3a62a57092f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:46:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2a62d563-7bd2-4f4a-918c-0ca09492ebc5 req-8e9c31f2-18d6-47e6-b733-8fe2b7b46d66 service nova] Acquired lock "refresh_cache-27a9c97c-e6f7-492a-808e-d3a62a57092f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:46:32 user nova-compute[75260]: DEBUG nova.network.neutron [req-2a62d563-7bd2-4f4a-918c-0ca09492ebc5 req-8e9c31f2-18d6-47e6-b733-8fe2b7b46d66 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Refreshing network info cache for port 616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:46:33 user nova-compute[75260]: DEBUG nova.network.neutron [req-2a62d563-7bd2-4f4a-918c-0ca09492ebc5 req-8e9c31f2-18d6-47e6-b733-8fe2b7b46d66 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Updated VIF entry in instance network info cache for port 616206c9-3674-4232-a547-4442283b73ad. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:46:33 user nova-compute[75260]: DEBUG nova.network.neutron [req-2a62d563-7bd2-4f4a-918c-0ca09492ebc5 req-8e9c31f2-18d6-47e6-b733-8fe2b7b46d66 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Updating instance_info_cache with network_info: [{"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2a62d563-7bd2-4f4a-918c-0ca09492ebc5 req-8e9c31f2-18d6-47e6-b733-8fe2b7b46d66 service nova] Releasing lock "refresh_cache-27a9c97c-e6f7-492a-808e-d3a62a57092f" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lazy-loading 'flavor' on Instance uuid 27a9c97c-e6f7-492a-808e-d3a62a57092f {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:36 user nova-compute[75260]: INFO nova.compute.manager [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Attaching volume 2032adde-8365-4bdf-aeaf-81622a36fbb4 to /dev/vdb
Nov 27 04:46:36 user nova-compute[75260]: DEBUG os_brick.utils [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c95bb4e-41a4-405a-bebc-59828fe6439c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[351423c4-c70b-4d43-8ec8-3e66d5032dcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[be89ca86-b17a-4371-9adf-c9a1d558066b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c8f361-1b32-4655-8d90-c2ba19ac1d28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:46:36 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:46:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9370c658-ea56-44f7-9e88-38d2e8310870]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG os_brick.utils [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Updating existing volume attachment record: d8ca7ffb-2700-4077-b708-59e4af9d9eaf {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:46:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:39 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:46:39 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:46:40 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:46:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfIuzPtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:46:42 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:46:42 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:46:42 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b585e56-eeb4-4a6a-82f2-324649ee96ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:46:42 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b3c7cc-a9c4-47db-8c87-4e6dda7fd558]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4] added
Nov 27 04:46:42 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d8666b-3cdb-4359-b4f4-2e71e0f6061b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[768ac628-a076-4a6f-85fb-b16ec57fa6b6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfIuzPtq {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfIuzPtq" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbff1418-7525-48bf-a31a-98fef3ec8919]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfIuzPtq'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[57263040-d72e-4a1e-8db8-ac3a1c4b66c7]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac695cbc-d0c1-40d7-92f1-05a4d04d11ef]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:46:43 user nova-compute[75260]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)
Nov 27 04:46:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:46:43 user nova-compute[75260]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)
Nov 27 04:46:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16a63b0-8d82-4bb6-a536-f51d2a3d368c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4, portal: 172.16.0.220,3260]
Nov 27 04:46:43 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4, portal: 172.16.0.220,3260] successful.
Nov 27 04:46:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0608e9-5012-4e03-a336-dc377203c633]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3da8d8-98ad-46a7-a498-d3caa072c712]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:46:43 user nova-compute[75260]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)
Nov 27 04:46:43 user nova-compute[75260]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 (non-flash)
Nov 27 04:46:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:46:43 user nova-compute[75260]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)
Nov 27 04:46:43 user nova-compute[75260]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 (non-flash)
Nov 27 04:46:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc80b7f2-820a-4698-8e13-100f2141dd4e]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfIuzPtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updating instance_info_cache with network_info: [{"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23837333263383933', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837333263383933', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG nova.objects.instance [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lazy-loading 'flavor' on Instance uuid 27a9c97c-e6f7-492a-808e-d3a62a57092f {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:46:44 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:46:44 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:46:44 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:46:44 user nova-compute[75260]:   <serial>2032adde-8365-4bdf-aeaf-81622a36fbb4</serial>
Nov 27 04:46:44 user nova-compute[75260]: </disk>
Nov 27 04:46:44 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] No VIF found with MAC fa:16:3e:2e:d8:c0, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb6a4807-8980-4bd4-84c3-7982bfc748b6 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.423s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:46:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:46 user nova-compute[75260]: INFO nova.compute.manager [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Detaching volume 2032adde-8365-4bdf-aeaf-81622a36fbb4
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:46 user nova-compute[75260]: INFO nova.virt.block_device [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Attempting to driver detach volume 2032adde-8365-4bdf-aeaf-81622a36fbb4 from mountpoint /dev/vdb
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Attempting to detach device vdb from instance 27a9c97c-e6f7-492a-808e-d3a62a57092f from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:46:46 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:46:46 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:46:46 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:46:46 user nova-compute[75260]:   <serial>2032adde-8365-4bdf-aeaf-81622a36fbb4</serial>
Nov 27 04:46:46 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:46:46 user nova-compute[75260]: </disk>
Nov 27 04:46:46 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:46:46 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Successfully detached device vdb from instance 27a9c97c-e6f7-492a-808e-d3a62a57092f from the persistent domain config.
Nov 27 04:46:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27a9c97c-e6f7-492a-808e-d3a62a57092f from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:46:46 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:46:46 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:46:46 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:46:46 user nova-compute[75260]:   <serial>2032adde-8365-4bdf-aeaf-81622a36fbb4</serial>
Nov 27 04:46:46 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:46:46 user nova-compute[75260]: </disk>
Nov 27 04:46:46 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27a9c97c-e6f7-492a-808e-d3a62a57092f {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:46:48 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7301MB free_disk=25.455524444580078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:48 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1100294c-ea5b-4994-885d-47357e7802c5 is timed out.
Nov 27 04:46:48 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Successfully detached device vdb from instance 1100294c-ea5b-4994-885d-47357e7802c5 from the live domain config.
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpEzLkPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:46:48 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c3fa13-a7d0-4913-aa9a-30253b417722]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:46:48 user nova-compute[75260]: No targets found.
Nov 27 04:46:48 user nova-compute[75260]: iSNS:
Nov 27 04:46:48 user nova-compute[75260]: No targets found.
Nov 27 04:46:48 user nova-compute[75260]: STATIC:
Nov 27 04:46:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8
Nov 27 04:46:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:46:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:46:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f
Nov 27 04:46:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:46:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:46:48 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4
Nov 27 04:46:48 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:46:48 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:46:48 user nova-compute[75260]: FIRMWARE:
Nov 27 04:46:48 user nova-compute[75260]: No targets found.
Nov 27 04:46:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:46:48 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:46:48 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac51c9-90b6-4bb3-96be-8cee527d19ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 12efb820-12ab-442d-a5fe-80b08f12a729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d0364679-4db1-4da8-bce8-80eea41feb13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1100294c-ea5b-4994-885d-47357e7802c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 27a9c97c-e6f7-492a-808e-d3a62a57092f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d732c23b-281e-44db-8af0-26d045278b80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 30d6ebaa-7c35-4eeb-8a06-789e691fbf08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88a7c20-37e4-44f2-9b5b-4aac7844df6a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:46:48 user nova-compute[75260]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)
Nov 27 04:46:48 user nova-compute[75260]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 (non-flash)
Nov 27 04:46:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:46:48 user nova-compute[75260]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 (non-flash)
Nov 27 04:46:48 user nova-compute[75260]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 (non-flash)
Nov 27 04:46:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c383d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[519e9ffd-c846-485f-8116-26ea7619ac26]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e73737f-6ecd-4cae-8cfa-92488f378dbe]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a249e17-488c-4e83-9307-e48c108b2ff5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc44371f-c989-4b9c-bf56-e4c95102fece]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9c4cfc-ce8e-4e5b-8ff4-69a705be6fb7]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[566d9dfe-e258-43f0-b044-a81ea09bab37]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8, portal: 172.16.0.220,3260]
Nov 27 04:46:48 user nova-compute[75260]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8, portal: 172.16.0.220,3260] successful.
Nov 27 04:46:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd3ad552-85b0-4f5f-8ea4-131c47e256b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be8d211-a4f9-4fb3-a729-b64fddc94a31]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] <== disconnect_volume: return (332ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:46:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:46:49 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:46:49 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:46:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:46:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:49 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:46:49 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:46:49 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:46:49 user nova-compute[75260]: DEBUG nova.objects.instance [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lazy-loading 'flavor' on Instance uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-307d2503-e4c4-47a4-934c-71465b32e002 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.752s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "interface-1100294c-ea5b-4994-885d-47357e7802c5-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "interface-1100294c-ea5b-4994-885d-47357e7802c5-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.objects.instance [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lazy-loading 'flavor' on Instance uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717557176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717557176',id=18,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW/qZPhLS1C8EQqzaoylt+DfXolIsqNuC0floaWTwm9Y8Kc2f0NOU/7QWq7h0reHBPBKp0h7iYnCXj4HbSmbHm1/Ah0OwOQu0068/YZcZc3v7umKCkKAxw0WIQGACGtqg==',key_name='tempest-keypair-875505160',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d9acefde97437abee0beaae079fcd9',ramdisk_id='',reservation_id='r-sco77w29',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-682424273',owner_user_name='tempest-TaggedAttachmentsTest-682424273-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a463d6bb05e471c9dfaf686d06202e1',uuid=1100294c-ea5b-4994-885d-47357e7802c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converting VIF {"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:89:a3"/><model type="virtio"/><mtu size="1442"/><target dev="tap45b06fa0-87"/></interface> {{(pid=75260) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:89:a3"/><model type="virtio"/><mtu size="1442"/><target dev="tap45b06fa0-87"/></interface> {{(pid=75260) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Attempting to detach device tap45b06fa0-87 from instance 1100294c-ea5b-4994-885d-47357e7802c5 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] detach device xml: <interface type="ethernet">
Nov 27 04:46:50 user nova-compute[75260]:   <mac address="fa:16:3e:b1:89:a3"/>
Nov 27 04:46:50 user nova-compute[75260]:   <model type="virtio"/>
Nov 27 04:46:50 user nova-compute[75260]:   <mtu size="1442"/>
Nov 27 04:46:50 user nova-compute[75260]:   <target dev="tap45b06fa0-87"/>
Nov 27 04:46:50 user nova-compute[75260]: </interface>
Nov 27 04:46:50 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:89:a3"/><model type="virtio"/><mtu size="1442"/><target dev="tap45b06fa0-87"/></interface> {{(pid=75260) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b1:89:a3"/><model type="virtio"/><mtu size="1442"/><target dev="tap45b06fa0-87"/></interface>not found in domain: <domain type='kvm' id='22'>
Nov 27 04:46:50 user nova-compute[75260]:   <name>instance-00000012</name>
Nov 27 04:46:50 user nova-compute[75260]:   <uuid>1100294c-ea5b-4994-885d-47357e7802c5</uuid>
Nov 27 04:46:50 user nova-compute[75260]:   <metadata>
Nov 27 04:46:50 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:46:50 user nova-compute[75260]:   <nova:package version="0.0.0"/>
Nov 27 04:46:50 user nova-compute[75260]:   <nova:name>tempest-device-tagging-server-717557176</nova:name>
Nov 27 04:46:50 user nova-compute[75260]:   <nova:creationTime>2023-11-27 04:46:16</nova:creationTime>
Nov 27 04:46:50 user nova-compute[75260]:   <nova:flavor name="m1.tiny">
Nov 27 04:46:50 user nova-compute[75260]:     <nova:memory>512</nova:memory>
Nov 27 04:46:50 user nova-compute[75260]:     <nova:disk>1</nova:disk>
Nov 27 04:46:50 user nova-compute[75260]:     <nova:swap>0</nova:swap>
Nov 27 04:46:50 user nova-compute[75260]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:46:50 user nova-compute[75260]:     <nova:vcpus>1</nova:vcpus>
Nov 27 04:46:50 user nova-compute[75260]:   </nova:flavor>
Nov 27 04:46:50 user nova-compute[75260]:   <nova:owner>
Nov 27 04:46:50 user nova-compute[75260]:     <nova:user uuid="8a463d6bb05e471c9dfaf686d06202e1">tempest-TaggedAttachmentsTest-682424273-project-member</nova:user>
Nov 27 04:46:50 user nova-compute[75260]:     <nova:project uuid="a3d9acefde97437abee0beaae079fcd9">tempest-TaggedAttachmentsTest-682424273</nova:project>
Nov 27 04:46:50 user nova-compute[75260]:   </nova:owner>
Nov 27 04:46:50 user nova-compute[75260]:   <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:46:50 user nova-compute[75260]:   <nova:ports>
Nov 27 04:46:50 user nova-compute[75260]:     <nova:port uuid="376192b1-f789-4b6f-be27-55efeb202f27">
Nov 27 04:46:50 user nova-compute[75260]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:46:50 user nova-compute[75260]:     </nova:port>
Nov 27 04:46:50 user nova-compute[75260]:     <nova:port uuid="45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e">
Nov 27 04:46:50 user nova-compute[75260]:       <nova:ip type="fixed" address="10.10.10.180" ipVersion="4"/>
Nov 27 04:46:50 user nova-compute[75260]:     </nova:port>
Nov 27 04:46:50 user nova-compute[75260]:   </nova:ports>
Nov 27 04:46:50 user nova-compute[75260]: </nova:instance>
Nov 27 04:46:50 user nova-compute[75260]:   </metadata>
Nov 27 04:46:50 user nova-compute[75260]:   <memory unit='KiB'>524288</memory>
Nov 27 04:46:50 user nova-compute[75260]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 04:46:50 user nova-compute[75260]:   <vcpu placement='static'>1</vcpu>
Nov 27 04:46:50 user nova-compute[75260]:   <resource>
Nov 27 04:46:50 user nova-compute[75260]:     <partition>/machine</partition>
Nov 27 04:46:50 user nova-compute[75260]:   </resource>
Nov 27 04:46:50 user nova-compute[75260]:   <sysinfo type='smbios'>
Nov 27 04:46:50 user nova-compute[75260]:     <system>
Nov 27 04:46:50 user nova-compute[75260]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 04:46:50 user nova-compute[75260]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 04:46:50 user nova-compute[75260]:       <entry name='version'>0.0.0</entry>
Nov 27 04:46:50 user nova-compute[75260]:       <entry name='serial'>1100294c-ea5b-4994-885d-47357e7802c5</entry>
Nov 27 04:46:50 user nova-compute[75260]:       <entry name='uuid'>1100294c-ea5b-4994-885d-47357e7802c5</entry>
Nov 27 04:46:50 user nova-compute[75260]:       <entry name='family'>Virtual Machine</entry>
Nov 27 04:46:50 user nova-compute[75260]:     </system>
Nov 27 04:46:50 user nova-compute[75260]:   </sysinfo>
Nov 27 04:46:50 user nova-compute[75260]:   <os>
Nov 27 04:46:50 user nova-compute[75260]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 04:46:50 user nova-compute[75260]:     <boot dev='hd'/>
Nov 27 04:46:50 user nova-compute[75260]:     <smbios mode='sysinfo'/>
Nov 27 04:46:50 user nova-compute[75260]:   </os>
Nov 27 04:46:50 user nova-compute[75260]:   <features>
Nov 27 04:46:50 user nova-compute[75260]:     <acpi/>
Nov 27 04:46:50 user nova-compute[75260]:     <apic/>
Nov 27 04:46:50 user nova-compute[75260]:     <vmcoreinfo state='on'/>
Nov 27 04:46:50 user nova-compute[75260]:   </features>
Nov 27 04:46:50 user nova-compute[75260]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 04:46:50 user nova-compute[75260]:     <model fallback='forbid'>Nehalem</model>
Nov 27 04:46:50 user nova-compute[75260]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 04:46:50 user nova-compute[75260]:     <feature policy='require' name='vme'/>
Nov 27 04:46:50 user nova-compute[75260]:     <feature policy='require' name='x2apic'/>
Nov 27 04:46:50 user nova-compute[75260]:     <feature policy='require' name='hypervisor'/>
Nov 27 04:46:50 user nova-compute[75260]:   </cpu>
Nov 27 04:46:50 user nova-compute[75260]:   <clock offset='utc'>
Nov 27 04:46:50 user nova-compute[75260]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 04:46:50 user nova-compute[75260]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 04:46:50 user nova-compute[75260]:     <timer name='hpet' present='no'/>
Nov 27 04:46:50 user nova-compute[75260]:   </clock>
Nov 27 04:46:50 user nova-compute[75260]:   <on_poweroff>destroy</on_poweroff>
Nov 27 04:46:50 user nova-compute[75260]:   <on_reboot>restart</on_reboot>
Nov 27 04:46:50 user nova-compute[75260]:   <on_crash>destroy</on_crash>
Nov 27 04:46:50 user nova-compute[75260]:   <devices>
Nov 27 04:46:50 user nova-compute[75260]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 04:46:50 user nova-compute[75260]:     <disk type='file' device='disk'>
Nov 27 04:46:50 user nova-compute[75260]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 04:46:50 user nova-compute[75260]:       <source file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk' index='2'/>
Nov 27 04:46:50 user nova-compute[75260]:       <backingStore type='file' index='3'>
Nov 27 04:46:50 user nova-compute[75260]:         <format type='raw'/>
Nov 27 04:46:50 user nova-compute[75260]:         <source file='/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86'/>
Nov 27 04:46:50 user nova-compute[75260]:         <backingStore/>
Nov 27 04:46:50 user nova-compute[75260]:       </backingStore>
Nov 27 04:46:50 user nova-compute[75260]:       <target dev='vda' bus='virtio'/>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='virtio-disk0'/>
Nov 27 04:46:50 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </disk>
Nov 27 04:46:50 user nova-compute[75260]:     <disk type='file' device='cdrom'>
Nov 27 04:46:50 user nova-compute[75260]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 04:46:50 user nova-compute[75260]:       <source file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.config' index='1'/>
Nov 27 04:46:50 user nova-compute[75260]:       <backingStore/>
Nov 27 04:46:50 user nova-compute[75260]:       <target dev='hda' bus='ide'/>
Nov 27 04:46:50 user nova-compute[75260]:       <readonly/>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='ide0-0-0'/>
Nov 27 04:46:50 user nova-compute[75260]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </disk>
Nov 27 04:46:50 user nova-compute[75260]:     <controller type='usb' index='0' model='none'>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='usb'/>
Nov 27 04:46:50 user nova-compute[75260]:     </controller>
Nov 27 04:46:50 user nova-compute[75260]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='pci.0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </controller>
Nov 27 04:46:50 user nova-compute[75260]:     <controller type='ide' index='0'>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='ide'/>
Nov 27 04:46:50 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 04:46:50 user nova-compute[75260]:     </controller>
Nov 27 04:46:50 user nova-compute[75260]:     <interface type='ethernet'>
Nov 27 04:46:50 user nova-compute[75260]:       <mac address='fa:16:3e:81:d6:58'/>
Nov 27 04:46:50 user nova-compute[75260]:       <target dev='tap376192b1-f7'/>
Nov 27 04:46:50 user nova-compute[75260]:       <model type='virtio'/>
Nov 27 04:46:50 user nova-compute[75260]:       <mtu size='1442'/>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='net0'/>
Nov 27 04:46:50 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </interface>
Nov 27 04:46:50 user nova-compute[75260]:     <interface type='ethernet'>
Nov 27 04:46:50 user nova-compute[75260]:       <mac address='fa:16:3e:b1:89:a3'/>
Nov 27 04:46:50 user nova-compute[75260]:       <target dev='tap45b06fa0-87'/>
Nov 27 04:46:50 user nova-compute[75260]:       <model type='virtio'/>
Nov 27 04:46:50 user nova-compute[75260]:       <mtu size='1442'/>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='net1'/>
Nov 27 04:46:50 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </interface>
Nov 27 04:46:50 user nova-compute[75260]:     <serial type='pty'>
Nov 27 04:46:50 user nova-compute[75260]:       <source path='/dev/pts/9'/>
Nov 27 04:46:50 user nova-compute[75260]:       <log file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/console.log' append='off'/>
Nov 27 04:46:50 user nova-compute[75260]:       <target type='isa-serial' port='0'>
Nov 27 04:46:50 user nova-compute[75260]:         <model name='isa-serial'/>
Nov 27 04:46:50 user nova-compute[75260]:       </target>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='serial0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </serial>
Nov 27 04:46:50 user nova-compute[75260]:     <console type='pty' tty='/dev/pts/9'>
Nov 27 04:46:50 user nova-compute[75260]:       <source path='/dev/pts/9'/>
Nov 27 04:46:50 user nova-compute[75260]:       <log file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/console.log' append='off'/>
Nov 27 04:46:50 user nova-compute[75260]:       <target type='serial' port='0'/>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='serial0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </console>
Nov 27 04:46:50 user nova-compute[75260]:     <input type='mouse' bus='ps2'>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='input0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </input>
Nov 27 04:46:50 user nova-compute[75260]:     <input type='keyboard' bus='ps2'>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='input1'/>
Nov 27 04:46:50 user nova-compute[75260]:     </input>
Nov 27 04:46:50 user nova-compute[75260]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 27 04:46:50 user nova-compute[75260]:       <listen type='address' address='0.0.0.0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </graphics>
Nov 27 04:46:50 user nova-compute[75260]:     <audio id='1' type='none'/>
Nov 27 04:46:50 user nova-compute[75260]:     <video>
Nov 27 04:46:50 user nova-compute[75260]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='video0'/>
Nov 27 04:46:50 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </video>
Nov 27 04:46:50 user nova-compute[75260]:     <memballoon model='virtio'>
Nov 27 04:46:50 user nova-compute[75260]:       <stats period='10'/>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='balloon0'/>
Nov 27 04:46:50 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </memballoon>
Nov 27 04:46:50 user nova-compute[75260]:     <rng model='virtio'>
Nov 27 04:46:50 user nova-compute[75260]:       <backend model='random'>/dev/urandom</backend>
Nov 27 04:46:50 user nova-compute[75260]:       <alias name='rng0'/>
Nov 27 04:46:50 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 04:46:50 user nova-compute[75260]:     </rng>
Nov 27 04:46:50 user nova-compute[75260]:   </devices>
Nov 27 04:46:50 user nova-compute[75260]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 04:46:50 user nova-compute[75260]:     <label>libvirt-1100294c-ea5b-4994-885d-47357e7802c5</label>
Nov 27 04:46:50 user nova-compute[75260]:     <imagelabel>libvirt-1100294c-ea5b-4994-885d-47357e7802c5</imagelabel>
Nov 27 04:46:50 user nova-compute[75260]:   </seclabel>
Nov 27 04:46:50 user nova-compute[75260]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 04:46:50 user nova-compute[75260]:     <label>+64055:+108</label>
Nov 27 04:46:50 user nova-compute[75260]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 04:46:50 user nova-compute[75260]:   </seclabel>
Nov 27 04:46:50 user nova-compute[75260]: </domain>
Nov 27 04:46:50 user nova-compute[75260]:  {{(pid=75260) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 04:46:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Successfully detached device tap45b06fa0-87 from instance 1100294c-ea5b-4994-885d-47357e7802c5 from the persistent domain config.
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] (1/8): Attempting to detach device tap45b06fa0-87 with device alias net1 from instance 1100294c-ea5b-4994-885d-47357e7802c5 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] detach device xml: <interface type="ethernet">
Nov 27 04:46:50 user nova-compute[75260]:   <mac address="fa:16:3e:b1:89:a3"/>
Nov 27 04:46:50 user nova-compute[75260]:   <model type="virtio"/>
Nov 27 04:46:50 user nova-compute[75260]:   <mtu size="1442"/>
Nov 27 04:46:50 user nova-compute[75260]:   <target dev="tap45b06fa0-87"/>
Nov 27 04:46:50 user nova-compute[75260]: </interface>
Nov 27 04:46:50 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Start waiting for the detach event from libvirt for device tap45b06fa0-87 with device alias net1 for instance 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:46:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-19e483c0-ac1a-4b87-af4b-d3026868a7f6 req-4e6a485d-3a54-4404-8003-524a610bc91a service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-unplugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-19e483c0-ac1a-4b87-af4b-d3026868a7f6 req-4e6a485d-3a54-4404-8003-524a610bc91a service nova] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-19e483c0-ac1a-4b87-af4b-d3026868a7f6 req-4e6a485d-3a54-4404-8003-524a610bc91a service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-19e483c0-ac1a-4b87-af4b-d3026868a7f6 req-4e6a485d-3a54-4404-8003-524a610bc91a service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-19e483c0-ac1a-4b87-af4b-d3026868a7f6 req-4e6a485d-3a54-4404-8003-524a610bc91a service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] No waiting events found dispatching network-vif-unplugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:51 user nova-compute[75260]: WARNING nova.compute.manager [req-19e483c0-ac1a-4b87-af4b-d3026868a7f6 req-4e6a485d-3a54-4404-8003-524a610bc91a service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received unexpected event network-vif-unplugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e for instance with vm_state active and task_state None.
Nov 27 04:46:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-29b8ff3f-ced6-406c-b0fe-8213d8f0664c req-63eecaf7-aac8-4a43-8712-f51aa5e8de65 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-plugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-29b8ff3f-ced6-406c-b0fe-8213d8f0664c req-63eecaf7-aac8-4a43-8712-f51aa5e8de65 service nova] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-29b8ff3f-ced6-406c-b0fe-8213d8f0664c req-63eecaf7-aac8-4a43-8712-f51aa5e8de65 service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-29b8ff3f-ced6-406c-b0fe-8213d8f0664c req-63eecaf7-aac8-4a43-8712-f51aa5e8de65 service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-29b8ff3f-ced6-406c-b0fe-8213d8f0664c req-63eecaf7-aac8-4a43-8712-f51aa5e8de65 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] No waiting events found dispatching network-vif-plugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:53 user nova-compute[75260]: WARNING nova.compute.manager [req-29b8ff3f-ced6-406c-b0fe-8213d8f0664c req-63eecaf7-aac8-4a43-8712-f51aa5e8de65 service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received unexpected event network-vif-plugged-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e for instance with vm_state active and task_state None.
Nov 27 04:46:53 user nova-compute[75260]: DEBUG nova.objects.instance [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:46:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquired lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:46:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:46:53 user nova-compute[75260]: DEBUG nova.objects.instance [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'info_cache' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:53 user nova-compute[75260]: DEBUG nova.objects.base [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.network.neutron [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updating instance_info_cache with network_info: [{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Releasing lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:46:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance destroyed successfully.
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.objects.instance [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'resources' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.objects.base [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658059163',display_name='tempest-AttachVolumeTestJSON-server-658059163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658059163',id=3,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/GFJ1RKiLPqz1av9ONhStQdrFP19obKkEGU7x+pfBUqsksA5dF6EGjTzeKbXRH4TNzkcH/co8UJKydluZFyoGJur/nedX5G2Wm9SLqgk6epiltTyDcIWj5HSqtnqbSFA==',key_name='tempest-keypair-531623201',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-4gzgeom6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=12efb820-12ab-442d-a5fe-80b08f12a729,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG os_vif [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape07f49c0-b8, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24398956-26df-4a21-bb94-30d3c8e217f4) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:54 user nova-compute[75260]: INFO os_vif [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8')
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Start _get_guest_xml network_info=[{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.objects.instance [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'numa_topology' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.objects.base [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:46:54 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:46:54 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.objects.instance [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'vcpu_model' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.objects.base [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658059163',display_name='tempest-AttachVolumeTestJSON-server-658059163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658059163',id=3,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/GFJ1RKiLPqz1av9ONhStQdrFP19obKkEGU7x+pfBUqsksA5dF6EGjTzeKbXRH4TNzkcH/co8UJKydluZFyoGJur/nedX5G2Wm9SLqgk6epiltTyDcIWj5HSqtnqbSFA==',key_name='tempest-keypair-531623201',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-4gzgeom6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=12efb820-12ab-442d-a5fe-80b08f12a729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.objects.instance [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'pci_devices' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.objects.base [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:46:54 user nova-compute[75260]:   <uuid>12efb820-12ab-442d-a5fe-80b08f12a729</uuid>
Nov 27 04:46:54 user nova-compute[75260]:   <name>instance-00000003</name>
Nov 27 04:46:54 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:46:54 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:46:54 user nova-compute[75260]:   <metadata>
Nov 27 04:46:54 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:46:54 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:46:54 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeTestJSON-server-658059163</nova:name>
Nov 27 04:46:54 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:46:54</nova:creationTime>
Nov 27 04:46:54 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:46:54 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:46:54 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:46:54 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:46:54 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:46:54 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:46:54 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:46:54 user nova-compute[75260]:       <nova:owner>
Nov 27 04:46:54 user nova-compute[75260]:         <nova:user uuid="1cbd63730ab84fa3aa9a05b06194ad4a">tempest-AttachVolumeTestJSON-2145472694-project-member</nova:user>
Nov 27 04:46:54 user nova-compute[75260]:         <nova:project uuid="ea8a8bd85b234d8e82487ead1232a644">tempest-AttachVolumeTestJSON-2145472694</nova:project>
Nov 27 04:46:54 user nova-compute[75260]:       </nova:owner>
Nov 27 04:46:54 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:46:54 user nova-compute[75260]:       <nova:ports>
Nov 27 04:46:54 user nova-compute[75260]:         <nova:port uuid="e07f49c0-b893-44bf-a195-c351eadfe333">
Nov 27 04:46:54 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 04:46:54 user nova-compute[75260]:         </nova:port>
Nov 27 04:46:54 user nova-compute[75260]:       </nova:ports>
Nov 27 04:46:54 user nova-compute[75260]:     </nova:instance>
Nov 27 04:46:54 user nova-compute[75260]:   </metadata>
Nov 27 04:46:54 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:46:54 user nova-compute[75260]:     <system>
Nov 27 04:46:54 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:46:54 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:46:54 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:46:54 user nova-compute[75260]:       <entry name="serial">12efb820-12ab-442d-a5fe-80b08f12a729</entry>
Nov 27 04:46:54 user nova-compute[75260]:       <entry name="uuid">12efb820-12ab-442d-a5fe-80b08f12a729</entry>
Nov 27 04:46:54 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:46:54 user nova-compute[75260]:     </system>
Nov 27 04:46:54 user nova-compute[75260]:   </sysinfo>
Nov 27 04:46:54 user nova-compute[75260]:   <os>
Nov 27 04:46:54 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:46:54 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:46:54 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:46:54 user nova-compute[75260]:   </os>
Nov 27 04:46:54 user nova-compute[75260]:   <features>
Nov 27 04:46:54 user nova-compute[75260]:     <acpi/>
Nov 27 04:46:54 user nova-compute[75260]:     <apic/>
Nov 27 04:46:54 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:46:54 user nova-compute[75260]:   </features>
Nov 27 04:46:54 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:46:54 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:46:54 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:46:54 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:46:54 user nova-compute[75260]:   </clock>
Nov 27 04:46:54 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:46:54 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:46:54 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:46:54 user nova-compute[75260]:   </cpu>
Nov 27 04:46:54 user nova-compute[75260]:   <devices>
Nov 27 04:46:54 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:46:54 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:46:54 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk"/>
Nov 27 04:46:54 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:46:54 user nova-compute[75260]:     </disk>
Nov 27 04:46:54 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:46:54 user nova-compute[75260]:       <mac address="fa:16:3e:7e:e4:1f"/>
Nov 27 04:46:54 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:46:54 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:46:54 user nova-compute[75260]:       <target dev="tape07f49c0-b8"/>
Nov 27 04:46:54 user nova-compute[75260]:     </interface>
Nov 27 04:46:54 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:46:54 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/console.log" append="off"/>
Nov 27 04:46:54 user nova-compute[75260]:     </serial>
Nov 27 04:46:54 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:46:54 user nova-compute[75260]:     <video>
Nov 27 04:46:54 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:46:54 user nova-compute[75260]:     </video>
Nov 27 04:46:54 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:46:54 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:46:54 user nova-compute[75260]:     </rng>
Nov 27 04:46:54 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:46:54 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:46:54 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:46:54 user nova-compute[75260]:     </memballoon>
Nov 27 04:46:54 user nova-compute[75260]:   </devices>
Nov 27 04:46:54 user nova-compute[75260]: </domain>
Nov 27 04:46:54 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.objects.instance [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'trusted_certs' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.objects.base [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:46:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Cannot resize image /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG nova.objects.instance [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'migration_context' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG nova.objects.base [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Object Instance<12efb820-12ab-442d-a5fe-80b08f12a729> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658059163',display_name='tempest-AttachVolumeTestJSON-server-658059163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658059163',id=3,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/GFJ1RKiLPqz1av9ONhStQdrFP19obKkEGU7x+pfBUqsksA5dF6EGjTzeKbXRH4TNzkcH/co8UJKydluZFyoGJur/nedX5G2Wm9SLqgk6epiltTyDcIWj5HSqtnqbSFA==',key_name='tempest-keypair-531623201',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-4gzgeom6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=12efb820-12ab-442d-a5fe-80b08f12a729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG os_vif [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '914d8451-7e13-5606-b344-cbb7df8842a4', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape07f49c0-b8, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape07f49c0-b8, col_values=(('qos', UUID('3174c905-3b47-4053-b408-8efda2cbed04')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape07f49c0-b8, col_values=(('external_ids', {'iface-id': 'e07f49c0-b893-44bf-a195-c351eadfe333', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:e4:1f', 'vm-uuid': '12efb820-12ab-442d-a5fe-80b08f12a729'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:46:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:55 user nova-compute[75260]: INFO os_vif [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8')
Nov 27 04:46:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-b044253f-2b52-469e-ad99-a1274f4201c6 req-3f95a951-65b7-4646-8888-330e31820d3a service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b044253f-2b52-469e-ad99-a1274f4201c6 req-3f95a951-65b7-4646-8888-330e31820d3a service nova] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b044253f-2b52-469e-ad99-a1274f4201c6 req-3f95a951-65b7-4646-8888-330e31820d3a service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b044253f-2b52-469e-ad99-a1274f4201c6 req-3f95a951-65b7-4646-8888-330e31820d3a service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-b044253f-2b52-469e-ad99-a1274f4201c6 req-3f95a951-65b7-4646-8888-330e31820d3a service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] No waiting events found dispatching network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:56 user nova-compute[75260]: WARNING nova.compute.manager [req-b044253f-2b52-469e-ad99-a1274f4201c6 req-3f95a951-65b7-4646-8888-330e31820d3a service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received unexpected event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 for instance with vm_state stopped and task_state powering-on.
Nov 27 04:46:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:46:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:46:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance rebooted successfully.
Nov 27 04:46:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-57a4733e-6e97-44b8-aac3-64522fa293f5 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:46:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-8d14e636-f808-48a4-8e80-b28c6a3fef0c req-5b03c88b-9719-4414-bfb0-c01de483bc1a service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:46:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8d14e636-f808-48a4-8e80-b28c6a3fef0c req-5b03c88b-9719-4414-bfb0-c01de483bc1a service nova] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:46:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8d14e636-f808-48a4-8e80-b28c6a3fef0c req-5b03c88b-9719-4414-bfb0-c01de483bc1a service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:46:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8d14e636-f808-48a4-8e80-b28c6a3fef0c req-5b03c88b-9719-4414-bfb0-c01de483bc1a service nova] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:46:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-8d14e636-f808-48a4-8e80-b28c6a3fef0c req-5b03c88b-9719-4414-bfb0-c01de483bc1a service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] No waiting events found dispatching network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:46:58 user nova-compute[75260]: WARNING nova.compute.manager [req-8d14e636-f808-48a4-8e80-b28c6a3fef0c req-5b03c88b-9719-4414-bfb0-c01de483bc1a service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received unexpected event network-vif-plugged-e07f49c0-b893-44bf-a195-c351eadfe333 for instance with vm_state active and task_state None.
Nov 27 04:47:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:06 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 27a9c97c-e6f7-492a-808e-d3a62a57092f is timed out.
Nov 27 04:47:06 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Successfully detached device vdb from instance 27a9c97c-e6f7-492a-808e-d3a62a57092f from the live domain config.
Nov 27 04:47:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfIuzPtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:47:06 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f2ec0-3ee6-4d11-972f-211899ecfa5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:47:06 user nova-compute[75260]: No targets found.
Nov 27 04:47:06 user nova-compute[75260]: iSNS:
Nov 27 04:47:06 user nova-compute[75260]: No targets found.
Nov 27 04:47:06 user nova-compute[75260]: STATIC:
Nov 27 04:47:06 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f
Nov 27 04:47:06 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:47:06 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:47:06 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4
Nov 27 04:47:06 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:47:06 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:47:06 user nova-compute[75260]: FIRMWARE:
Nov 27 04:47:06 user nova-compute[75260]: No targets found.
Nov 27 04:47:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:47:06 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:47:06 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6916d0f1-71d5-49e6-9b81-cdf537820556]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7b859f-f9b7-4b71-8895-1242820a48c1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:47:06 user nova-compute[75260]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 (non-flash)
Nov 27 04:47:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:47:06 user nova-compute[75260]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 (non-flash)
Nov 27 04:47:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54623e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d30ff86-01ce-4962-8b91-7f52bfc2408c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e711a1d-f49e-4cfd-8cb1-de334d66b04f]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:06 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cf11cc-00c6-44dc-a5f2-778f0b2f19db]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[818439a2-e354-4791-bbcb-4fe17ff4afcf]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[76707229-c402-494a-b683-1b90cc394213]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce0abb5-8289-446c-96f2-8b603c9bafb7]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4, portal: 172.16.0.220,3260]
Nov 27 04:47:07 user nova-compute[75260]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4, portal: 172.16.0.220,3260] successful.
Nov 27 04:47:07 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2032adde-8365-4bdf-aeaf-81622a36fbb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[578f98b0-617c-4260-a8ac-f31391eea0c1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] <== disconnect_volume: return (315ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:47:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:47:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lazy-loading 'flavor' on Instance uuid 27a9c97c-e6f7-492a-808e-d3a62a57092f {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-62d6f6b8-4345-4bb6-9a14-b679adbcbe65 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.824s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:10 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Waiting for libvirt event about the detach of device tap45b06fa0-87 with device alias net1 from instance 1100294c-ea5b-4994-885d-47357e7802c5 is timed out.
Nov 27 04:47:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:89:a3"/><model type="virtio"/><mtu size="1442"/><target dev="tap45b06fa0-87"/></interface> {{(pid=75260) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 04:47:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b1:89:a3"/><model type="virtio"/><mtu size="1442"/><target dev="tap45b06fa0-87"/></interface>not found in domain: <domain type='kvm' id='22'>
Nov 27 04:47:10 user nova-compute[75260]:   <name>instance-00000012</name>
Nov 27 04:47:10 user nova-compute[75260]:   <uuid>1100294c-ea5b-4994-885d-47357e7802c5</uuid>
Nov 27 04:47:10 user nova-compute[75260]:   <metadata>
Nov 27 04:47:10 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:47:10 user nova-compute[75260]:   <nova:package version="0.0.0"/>
Nov 27 04:47:10 user nova-compute[75260]:   <nova:name>tempest-device-tagging-server-717557176</nova:name>
Nov 27 04:47:10 user nova-compute[75260]:   <nova:creationTime>2023-11-27 04:46:16</nova:creationTime>
Nov 27 04:47:10 user nova-compute[75260]:   <nova:flavor name="m1.tiny">
Nov 27 04:47:10 user nova-compute[75260]:     <nova:memory>512</nova:memory>
Nov 27 04:47:10 user nova-compute[75260]:     <nova:disk>1</nova:disk>
Nov 27 04:47:10 user nova-compute[75260]:     <nova:swap>0</nova:swap>
Nov 27 04:47:10 user nova-compute[75260]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:47:10 user nova-compute[75260]:     <nova:vcpus>1</nova:vcpus>
Nov 27 04:47:10 user nova-compute[75260]:   </nova:flavor>
Nov 27 04:47:10 user nova-compute[75260]:   <nova:owner>
Nov 27 04:47:10 user nova-compute[75260]:     <nova:user uuid="8a463d6bb05e471c9dfaf686d06202e1">tempest-TaggedAttachmentsTest-682424273-project-member</nova:user>
Nov 27 04:47:10 user nova-compute[75260]:     <nova:project uuid="a3d9acefde97437abee0beaae079fcd9">tempest-TaggedAttachmentsTest-682424273</nova:project>
Nov 27 04:47:10 user nova-compute[75260]:   </nova:owner>
Nov 27 04:47:10 user nova-compute[75260]:   <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:47:10 user nova-compute[75260]:   <nova:ports>
Nov 27 04:47:10 user nova-compute[75260]:     <nova:port uuid="376192b1-f789-4b6f-be27-55efeb202f27">
Nov 27 04:47:10 user nova-compute[75260]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:47:10 user nova-compute[75260]:     </nova:port>
Nov 27 04:47:10 user nova-compute[75260]:     <nova:port uuid="45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e">
Nov 27 04:47:10 user nova-compute[75260]:       <nova:ip type="fixed" address="10.10.10.180" ipVersion="4"/>
Nov 27 04:47:10 user nova-compute[75260]:     </nova:port>
Nov 27 04:47:10 user nova-compute[75260]:   </nova:ports>
Nov 27 04:47:10 user nova-compute[75260]: </nova:instance>
Nov 27 04:47:10 user nova-compute[75260]:   </metadata>
Nov 27 04:47:10 user nova-compute[75260]:   <memory unit='KiB'>524288</memory>
Nov 27 04:47:10 user nova-compute[75260]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 04:47:10 user nova-compute[75260]:   <vcpu placement='static'>1</vcpu>
Nov 27 04:47:10 user nova-compute[75260]:   <resource>
Nov 27 04:47:10 user nova-compute[75260]:     <partition>/machine</partition>
Nov 27 04:47:10 user nova-compute[75260]:   </resource>
Nov 27 04:47:10 user nova-compute[75260]:   <sysinfo type='smbios'>
Nov 27 04:47:10 user nova-compute[75260]:     <system>
Nov 27 04:47:10 user nova-compute[75260]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 04:47:10 user nova-compute[75260]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 04:47:10 user nova-compute[75260]:       <entry name='version'>0.0.0</entry>
Nov 27 04:47:10 user nova-compute[75260]:       <entry name='serial'>1100294c-ea5b-4994-885d-47357e7802c5</entry>
Nov 27 04:47:10 user nova-compute[75260]:       <entry name='uuid'>1100294c-ea5b-4994-885d-47357e7802c5</entry>
Nov 27 04:47:10 user nova-compute[75260]:       <entry name='family'>Virtual Machine</entry>
Nov 27 04:47:10 user nova-compute[75260]:     </system>
Nov 27 04:47:10 user nova-compute[75260]:   </sysinfo>
Nov 27 04:47:10 user nova-compute[75260]:   <os>
Nov 27 04:47:10 user nova-compute[75260]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 04:47:10 user nova-compute[75260]:     <boot dev='hd'/>
Nov 27 04:47:10 user nova-compute[75260]:     <smbios mode='sysinfo'/>
Nov 27 04:47:10 user nova-compute[75260]:   </os>
Nov 27 04:47:10 user nova-compute[75260]:   <features>
Nov 27 04:47:10 user nova-compute[75260]:     <acpi/>
Nov 27 04:47:10 user nova-compute[75260]:     <apic/>
Nov 27 04:47:10 user nova-compute[75260]:     <vmcoreinfo state='on'/>
Nov 27 04:47:10 user nova-compute[75260]:   </features>
Nov 27 04:47:10 user nova-compute[75260]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 04:47:10 user nova-compute[75260]:     <model fallback='forbid'>Nehalem</model>
Nov 27 04:47:10 user nova-compute[75260]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 04:47:10 user nova-compute[75260]:     <feature policy='require' name='vme'/>
Nov 27 04:47:10 user nova-compute[75260]:     <feature policy='require' name='x2apic'/>
Nov 27 04:47:10 user nova-compute[75260]:     <feature policy='require' name='hypervisor'/>
Nov 27 04:47:10 user nova-compute[75260]:   </cpu>
Nov 27 04:47:10 user nova-compute[75260]:   <clock offset='utc'>
Nov 27 04:47:10 user nova-compute[75260]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 04:47:10 user nova-compute[75260]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 04:47:10 user nova-compute[75260]:     <timer name='hpet' present='no'/>
Nov 27 04:47:10 user nova-compute[75260]:   </clock>
Nov 27 04:47:10 user nova-compute[75260]:   <on_poweroff>destroy</on_poweroff>
Nov 27 04:47:10 user nova-compute[75260]:   <on_reboot>restart</on_reboot>
Nov 27 04:47:10 user nova-compute[75260]:   <on_crash>destroy</on_crash>
Nov 27 04:47:10 user nova-compute[75260]:   <devices>
Nov 27 04:47:10 user nova-compute[75260]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 04:47:10 user nova-compute[75260]:     <disk type='file' device='disk'>
Nov 27 04:47:10 user nova-compute[75260]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 04:47:10 user nova-compute[75260]:       <source file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk' index='2'/>
Nov 27 04:47:10 user nova-compute[75260]:       <backingStore type='file' index='3'>
Nov 27 04:47:10 user nova-compute[75260]:         <format type='raw'/>
Nov 27 04:47:10 user nova-compute[75260]:         <source file='/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86'/>
Nov 27 04:47:10 user nova-compute[75260]:         <backingStore/>
Nov 27 04:47:10 user nova-compute[75260]:       </backingStore>
Nov 27 04:47:10 user nova-compute[75260]:       <target dev='vda' bus='virtio'/>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='virtio-disk0'/>
Nov 27 04:47:10 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </disk>
Nov 27 04:47:10 user nova-compute[75260]:     <disk type='file' device='cdrom'>
Nov 27 04:47:10 user nova-compute[75260]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 04:47:10 user nova-compute[75260]:       <source file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.config' index='1'/>
Nov 27 04:47:10 user nova-compute[75260]:       <backingStore/>
Nov 27 04:47:10 user nova-compute[75260]:       <target dev='hda' bus='ide'/>
Nov 27 04:47:10 user nova-compute[75260]:       <readonly/>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='ide0-0-0'/>
Nov 27 04:47:10 user nova-compute[75260]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </disk>
Nov 27 04:47:10 user nova-compute[75260]:     <controller type='usb' index='0' model='none'>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='usb'/>
Nov 27 04:47:10 user nova-compute[75260]:     </controller>
Nov 27 04:47:10 user nova-compute[75260]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='pci.0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </controller>
Nov 27 04:47:10 user nova-compute[75260]:     <controller type='ide' index='0'>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='ide'/>
Nov 27 04:47:10 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 04:47:10 user nova-compute[75260]:     </controller>
Nov 27 04:47:10 user nova-compute[75260]:     <interface type='ethernet'>
Nov 27 04:47:10 user nova-compute[75260]:       <mac address='fa:16:3e:81:d6:58'/>
Nov 27 04:47:10 user nova-compute[75260]:       <target dev='tap376192b1-f7'/>
Nov 27 04:47:10 user nova-compute[75260]:       <model type='virtio'/>
Nov 27 04:47:10 user nova-compute[75260]:       <mtu size='1442'/>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='net0'/>
Nov 27 04:47:10 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </interface>
Nov 27 04:47:10 user nova-compute[75260]:     <serial type='pty'>
Nov 27 04:47:10 user nova-compute[75260]:       <source path='/dev/pts/9'/>
Nov 27 04:47:10 user nova-compute[75260]:       <log file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/console.log' append='off'/>
Nov 27 04:47:10 user nova-compute[75260]:       <target type='isa-serial' port='0'>
Nov 27 04:47:10 user nova-compute[75260]:         <model name='isa-serial'/>
Nov 27 04:47:10 user nova-compute[75260]:       </target>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='serial0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </serial>
Nov 27 04:47:10 user nova-compute[75260]:     <console type='pty' tty='/dev/pts/9'>
Nov 27 04:47:10 user nova-compute[75260]:       <source path='/dev/pts/9'/>
Nov 27 04:47:10 user nova-compute[75260]:       <log file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/console.log' append='off'/>
Nov 27 04:47:10 user nova-compute[75260]:       <target type='serial' port='0'/>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='serial0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </console>
Nov 27 04:47:10 user nova-compute[75260]:     <input type='mouse' bus='ps2'>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='input0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </input>
Nov 27 04:47:10 user nova-compute[75260]:     <input type='keyboard' bus='ps2'>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='input1'/>
Nov 27 04:47:10 user nova-compute[75260]:     </input>
Nov 27 04:47:10 user nova-compute[75260]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 27 04:47:10 user nova-compute[75260]:       <listen type='address' address='0.0.0.0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </graphics>
Nov 27 04:47:10 user nova-compute[75260]:     <audio id='1' type='none'/>
Nov 27 04:47:10 user nova-compute[75260]:     <video>
Nov 27 04:47:10 user nova-compute[75260]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='video0'/>
Nov 27 04:47:10 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </video>
Nov 27 04:47:10 user nova-compute[75260]:     <memballoon model='virtio'>
Nov 27 04:47:10 user nova-compute[75260]:       <stats period='10'/>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='balloon0'/>
Nov 27 04:47:10 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </memballoon>
Nov 27 04:47:10 user nova-compute[75260]:     <rng model='virtio'>
Nov 27 04:47:10 user nova-compute[75260]:       <backend model='random'>/dev/urandom</backend>
Nov 27 04:47:10 user nova-compute[75260]:       <alias name='rng0'/>
Nov 27 04:47:10 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 04:47:10 user nova-compute[75260]:     </rng>
Nov 27 04:47:10 user nova-compute[75260]:   </devices>
Nov 27 04:47:10 user nova-compute[75260]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 04:47:10 user nova-compute[75260]:     <label>libvirt-1100294c-ea5b-4994-885d-47357e7802c5</label>
Nov 27 04:47:10 user nova-compute[75260]:     <imagelabel>libvirt-1100294c-ea5b-4994-885d-47357e7802c5</imagelabel>
Nov 27 04:47:10 user nova-compute[75260]:   </seclabel>
Nov 27 04:47:10 user nova-compute[75260]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 04:47:10 user nova-compute[75260]:     <label>+64055:+108</label>
Nov 27 04:47:10 user nova-compute[75260]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 04:47:10 user nova-compute[75260]:   </seclabel>
Nov 27 04:47:10 user nova-compute[75260]: </domain>
Nov 27 04:47:10 user nova-compute[75260]:  {{(pid=75260) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 04:47:11 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Successfully detached device tap45b06fa0-87 from instance 1100294c-ea5b-4994-885d-47357e7802c5 from the live domain config.
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717557176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717557176',id=18,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW/qZPhLS1C8EQqzaoylt+DfXolIsqNuC0floaWTwm9Y8Kc2f0NOU/7QWq7h0reHBPBKp0h7iYnCXj4HbSmbHm1/Ah0OwOQu0068/YZcZc3v7umKCkKAxw0WIQGACGtqg==',key_name='tempest-keypair-875505160',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d9acefde97437abee0beaae079fcd9',ramdisk_id='',reservation_id='r-sco77w29',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-682424273',owner_user_name='tempest-TaggedAttachmentsTest-682424273-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a463d6bb05e471c9dfaf686d06202e1',uuid=1100294c-ea5b-4994-885d-47357e7802c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converting VIF {"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG os_vif [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45b06fa0-87, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9dbebff0-2e96-47b5-b274-b359d882b45f) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:11 user nova-compute[75260]: INFO os_vif [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87')
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:47:11 user nova-compute[75260]:   <nova:package version="0.0.0"/>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:name>tempest-device-tagging-server-717557176</nova:name>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:creationTime>2023-11-27 04:47:11</nova:creationTime>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:flavor name="m1.tiny">
Nov 27 04:47:11 user nova-compute[75260]:     <nova:memory>512</nova:memory>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:disk>1</nova:disk>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:swap>0</nova:swap>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:vcpus>1</nova:vcpus>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:flavor>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:owner>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:user uuid="8a463d6bb05e471c9dfaf686d06202e1">tempest-TaggedAttachmentsTest-682424273-project-member</nova:user>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:project uuid="a3d9acefde97437abee0beaae079fcd9">tempest-TaggedAttachmentsTest-682424273</nova:project>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:owner>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:ports>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:port uuid="376192b1-f789-4b6f-be27-55efeb202f27">
Nov 27 04:47:11 user nova-compute[75260]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:47:11 user nova-compute[75260]:     </nova:port>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:ports>
Nov 27 04:47:11 user nova-compute[75260]: </nova:instance>
Nov 27 04:47:11 user nova-compute[75260]:  {{(pid=75260) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-deleted-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:11 user nova-compute[75260]: INFO nova.compute.manager [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Neutron deleted interface 45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e; detaching it from the instance and deleting it from the info cache
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.network.neutron [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updating instance_info_cache with network_info: [{"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquired lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.network.neutron [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.objects.instance [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] Lazy-loading 'system_metadata' on Instance uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.objects.instance [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] Lazy-loading 'flavor' on Instance uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.objects.base [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] Object Instance<1100294c-ea5b-4994-885d-47357e7802c5> lazy-loaded attributes: system_metadata,flavor {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717557176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717557176',id=18,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW/qZPhLS1C8EQqzaoylt+DfXolIsqNuC0floaWTwm9Y8Kc2f0NOU/7QWq7h0reHBPBKp0h7iYnCXj4HbSmbHm1/Ah0OwOQu0068/YZcZc3v7umKCkKAxw0WIQGACGtqg==',key_name='tempest-keypair-875505160',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d9acefde97437abee0beaae079fcd9',ramdisk_id='',reservation_id='r-sco77w29',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-682424273',owner_user_name='tempest-TaggedAttachmentsTest-682424273-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a463d6bb05e471c9dfaf686d06202e1',uuid=1100294c-ea5b-4994-885d-47357e7802c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.network.os_vif_util [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] Converting VIF {"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.network.os_vif_util [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:89:a3"/><model type="virtio"/><mtu size="1442"/><target dev="tap45b06fa0-87"/></interface> {{(pid=75260) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b1:89:a3"/><model type="virtio"/><mtu size="1442"/><target dev="tap45b06fa0-87"/></interface>not found in domain: <domain type='kvm' id='22'>
Nov 27 04:47:11 user nova-compute[75260]:   <name>instance-00000012</name>
Nov 27 04:47:11 user nova-compute[75260]:   <uuid>1100294c-ea5b-4994-885d-47357e7802c5</uuid>
Nov 27 04:47:11 user nova-compute[75260]:   <metadata>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:47:11 user nova-compute[75260]:   <nova:package version="0.0.0"/>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:name>tempest-device-tagging-server-717557176</nova:name>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:creationTime>2023-11-27 04:47:11</nova:creationTime>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:flavor name="m1.tiny">
Nov 27 04:47:11 user nova-compute[75260]:     <nova:memory>512</nova:memory>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:disk>1</nova:disk>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:swap>0</nova:swap>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:vcpus>1</nova:vcpus>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:flavor>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:owner>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:user uuid="8a463d6bb05e471c9dfaf686d06202e1">tempest-TaggedAttachmentsTest-682424273-project-member</nova:user>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:project uuid="a3d9acefde97437abee0beaae079fcd9">tempest-TaggedAttachmentsTest-682424273</nova:project>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:owner>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:ports>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:port uuid="376192b1-f789-4b6f-be27-55efeb202f27">
Nov 27 04:47:11 user nova-compute[75260]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:47:11 user nova-compute[75260]:     </nova:port>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:ports>
Nov 27 04:47:11 user nova-compute[75260]: </nova:instance>
Nov 27 04:47:11 user nova-compute[75260]:   </metadata>
Nov 27 04:47:11 user nova-compute[75260]:   <memory unit='KiB'>524288</memory>
Nov 27 04:47:11 user nova-compute[75260]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 04:47:11 user nova-compute[75260]:   <vcpu placement='static'>1</vcpu>
Nov 27 04:47:11 user nova-compute[75260]:   <resource>
Nov 27 04:47:11 user nova-compute[75260]:     <partition>/machine</partition>
Nov 27 04:47:11 user nova-compute[75260]:   </resource>
Nov 27 04:47:11 user nova-compute[75260]:   <sysinfo type='smbios'>
Nov 27 04:47:11 user nova-compute[75260]:     <system>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='version'>0.0.0</entry>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='serial'>1100294c-ea5b-4994-885d-47357e7802c5</entry>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='uuid'>1100294c-ea5b-4994-885d-47357e7802c5</entry>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='family'>Virtual Machine</entry>
Nov 27 04:47:11 user nova-compute[75260]:     </system>
Nov 27 04:47:11 user nova-compute[75260]:   </sysinfo>
Nov 27 04:47:11 user nova-compute[75260]:   <os>
Nov 27 04:47:11 user nova-compute[75260]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 04:47:11 user nova-compute[75260]:     <boot dev='hd'/>
Nov 27 04:47:11 user nova-compute[75260]:     <smbios mode='sysinfo'/>
Nov 27 04:47:11 user nova-compute[75260]:   </os>
Nov 27 04:47:11 user nova-compute[75260]:   <features>
Nov 27 04:47:11 user nova-compute[75260]:     <acpi/>
Nov 27 04:47:11 user nova-compute[75260]:     <apic/>
Nov 27 04:47:11 user nova-compute[75260]:     <vmcoreinfo state='on'/>
Nov 27 04:47:11 user nova-compute[75260]:   </features>
Nov 27 04:47:11 user nova-compute[75260]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 04:47:11 user nova-compute[75260]:     <model fallback='forbid'>Nehalem</model>
Nov 27 04:47:11 user nova-compute[75260]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 04:47:11 user nova-compute[75260]:     <feature policy='require' name='vme'/>
Nov 27 04:47:11 user nova-compute[75260]:     <feature policy='require' name='x2apic'/>
Nov 27 04:47:11 user nova-compute[75260]:     <feature policy='require' name='hypervisor'/>
Nov 27 04:47:11 user nova-compute[75260]:   </cpu>
Nov 27 04:47:11 user nova-compute[75260]:   <clock offset='utc'>
Nov 27 04:47:11 user nova-compute[75260]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 04:47:11 user nova-compute[75260]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 04:47:11 user nova-compute[75260]:     <timer name='hpet' present='no'/>
Nov 27 04:47:11 user nova-compute[75260]:   </clock>
Nov 27 04:47:11 user nova-compute[75260]:   <on_poweroff>destroy</on_poweroff>
Nov 27 04:47:11 user nova-compute[75260]:   <on_reboot>restart</on_reboot>
Nov 27 04:47:11 user nova-compute[75260]:   <on_crash>destroy</on_crash>
Nov 27 04:47:11 user nova-compute[75260]:   <devices>
Nov 27 04:47:11 user nova-compute[75260]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 04:47:11 user nova-compute[75260]:     <disk type='file' device='disk'>
Nov 27 04:47:11 user nova-compute[75260]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 04:47:11 user nova-compute[75260]:       <source file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk' index='2'/>
Nov 27 04:47:11 user nova-compute[75260]:       <backingStore type='file' index='3'>
Nov 27 04:47:11 user nova-compute[75260]:         <format type='raw'/>
Nov 27 04:47:11 user nova-compute[75260]:         <source file='/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86'/>
Nov 27 04:47:11 user nova-compute[75260]:         <backingStore/>
Nov 27 04:47:11 user nova-compute[75260]:       </backingStore>
Nov 27 04:47:11 user nova-compute[75260]:       <target dev='vda' bus='virtio'/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='virtio-disk0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </disk>
Nov 27 04:47:11 user nova-compute[75260]:     <disk type='file' device='cdrom'>
Nov 27 04:47:11 user nova-compute[75260]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 04:47:11 user nova-compute[75260]:       <source file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.config' index='1'/>
Nov 27 04:47:11 user nova-compute[75260]:       <backingStore/>
Nov 27 04:47:11 user nova-compute[75260]:       <target dev='hda' bus='ide'/>
Nov 27 04:47:11 user nova-compute[75260]:       <readonly/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='ide0-0-0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </disk>
Nov 27 04:47:11 user nova-compute[75260]:     <controller type='usb' index='0' model='none'>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='usb'/>
Nov 27 04:47:11 user nova-compute[75260]:     </controller>
Nov 27 04:47:11 user nova-compute[75260]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='pci.0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </controller>
Nov 27 04:47:11 user nova-compute[75260]:     <controller type='ide' index='0'>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='ide'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 04:47:11 user nova-compute[75260]:     </controller>
Nov 27 04:47:11 user nova-compute[75260]:     <interface type='ethernet'>
Nov 27 04:47:11 user nova-compute[75260]:       <mac address='fa:16:3e:81:d6:58'/>
Nov 27 04:47:11 user nova-compute[75260]:       <target dev='tap376192b1-f7'/>
Nov 27 04:47:11 user nova-compute[75260]:       <model type='virtio'/>
Nov 27 04:47:11 user nova-compute[75260]:       <mtu size='1442'/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='net0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </interface>
Nov 27 04:47:11 user nova-compute[75260]:     <serial type='pty'>
Nov 27 04:47:11 user nova-compute[75260]:       <source path='/dev/pts/9'/>
Nov 27 04:47:11 user nova-compute[75260]:       <log file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/console.log' append='off'/>
Nov 27 04:47:11 user nova-compute[75260]:       <target type='isa-serial' port='0'>
Nov 27 04:47:11 user nova-compute[75260]:         <model name='isa-serial'/>
Nov 27 04:47:11 user nova-compute[75260]:       </target>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='serial0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </serial>
Nov 27 04:47:11 user nova-compute[75260]:     <console type='pty' tty='/dev/pts/9'>
Nov 27 04:47:11 user nova-compute[75260]:       <source path='/dev/pts/9'/>
Nov 27 04:47:11 user nova-compute[75260]:       <log file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/console.log' append='off'/>
Nov 27 04:47:11 user nova-compute[75260]:       <target type='serial' port='0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='serial0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </console>
Nov 27 04:47:11 user nova-compute[75260]:     <input type='mouse' bus='ps2'>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='input0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </input>
Nov 27 04:47:11 user nova-compute[75260]:     <input type='keyboard' bus='ps2'>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='input1'/>
Nov 27 04:47:11 user nova-compute[75260]:     </input>
Nov 27 04:47:11 user nova-compute[75260]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 27 04:47:11 user nova-compute[75260]:       <listen type='address' address='0.0.0.0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </graphics>
Nov 27 04:47:11 user nova-compute[75260]:     <audio id='1' type='none'/>
Nov 27 04:47:11 user nova-compute[75260]:     <video>
Nov 27 04:47:11 user nova-compute[75260]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='video0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </video>
Nov 27 04:47:11 user nova-compute[75260]:     <memballoon model='virtio'>
Nov 27 04:47:11 user nova-compute[75260]:       <stats period='10'/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='balloon0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </memballoon>
Nov 27 04:47:11 user nova-compute[75260]:     <rng model='virtio'>
Nov 27 04:47:11 user nova-compute[75260]:       <backend model='random'>/dev/urandom</backend>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='rng0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </rng>
Nov 27 04:47:11 user nova-compute[75260]:   </devices>
Nov 27 04:47:11 user nova-compute[75260]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 04:47:11 user nova-compute[75260]:     <label>libvirt-1100294c-ea5b-4994-885d-47357e7802c5</label>
Nov 27 04:47:11 user nova-compute[75260]:     <imagelabel>libvirt-1100294c-ea5b-4994-885d-47357e7802c5</imagelabel>
Nov 27 04:47:11 user nova-compute[75260]:   </seclabel>
Nov 27 04:47:11 user nova-compute[75260]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 04:47:11 user nova-compute[75260]:     <label>+64055:+108</label>
Nov 27 04:47:11 user nova-compute[75260]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 04:47:11 user nova-compute[75260]:   </seclabel>
Nov 27 04:47:11 user nova-compute[75260]: </domain>
Nov 27 04:47:11 user nova-compute[75260]:  {{(pid=75260) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b1:89:a3"/><model type="virtio"/><mtu size="1442"/><target dev="tap45b06fa0-87"/></interface> {{(pid=75260) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b1:89:a3"/><model type="virtio"/><mtu size="1442"/><target dev="tap45b06fa0-87"/></interface>not found in domain: <domain type='kvm' id='22'>
Nov 27 04:47:11 user nova-compute[75260]:   <name>instance-00000012</name>
Nov 27 04:47:11 user nova-compute[75260]:   <uuid>1100294c-ea5b-4994-885d-47357e7802c5</uuid>
Nov 27 04:47:11 user nova-compute[75260]:   <metadata>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:47:11 user nova-compute[75260]:   <nova:package version="0.0.0"/>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:name>tempest-device-tagging-server-717557176</nova:name>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:creationTime>2023-11-27 04:47:11</nova:creationTime>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:flavor name="m1.tiny">
Nov 27 04:47:11 user nova-compute[75260]:     <nova:memory>512</nova:memory>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:disk>1</nova:disk>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:swap>0</nova:swap>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:vcpus>1</nova:vcpus>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:flavor>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:owner>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:user uuid="8a463d6bb05e471c9dfaf686d06202e1">tempest-TaggedAttachmentsTest-682424273-project-member</nova:user>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:project uuid="a3d9acefde97437abee0beaae079fcd9">tempest-TaggedAttachmentsTest-682424273</nova:project>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:owner>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:ports>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:port uuid="376192b1-f789-4b6f-be27-55efeb202f27">
Nov 27 04:47:11 user nova-compute[75260]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:47:11 user nova-compute[75260]:     </nova:port>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:ports>
Nov 27 04:47:11 user nova-compute[75260]: </nova:instance>
Nov 27 04:47:11 user nova-compute[75260]:   </metadata>
Nov 27 04:47:11 user nova-compute[75260]:   <memory unit='KiB'>524288</memory>
Nov 27 04:47:11 user nova-compute[75260]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 04:47:11 user nova-compute[75260]:   <vcpu placement='static'>1</vcpu>
Nov 27 04:47:11 user nova-compute[75260]:   <resource>
Nov 27 04:47:11 user nova-compute[75260]:     <partition>/machine</partition>
Nov 27 04:47:11 user nova-compute[75260]:   </resource>
Nov 27 04:47:11 user nova-compute[75260]:   <sysinfo type='smbios'>
Nov 27 04:47:11 user nova-compute[75260]:     <system>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='version'>0.0.0</entry>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='serial'>1100294c-ea5b-4994-885d-47357e7802c5</entry>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='uuid'>1100294c-ea5b-4994-885d-47357e7802c5</entry>
Nov 27 04:47:11 user nova-compute[75260]:       <entry name='family'>Virtual Machine</entry>
Nov 27 04:47:11 user nova-compute[75260]:     </system>
Nov 27 04:47:11 user nova-compute[75260]:   </sysinfo>
Nov 27 04:47:11 user nova-compute[75260]:   <os>
Nov 27 04:47:11 user nova-compute[75260]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 04:47:11 user nova-compute[75260]:     <boot dev='hd'/>
Nov 27 04:47:11 user nova-compute[75260]:     <smbios mode='sysinfo'/>
Nov 27 04:47:11 user nova-compute[75260]:   </os>
Nov 27 04:47:11 user nova-compute[75260]:   <features>
Nov 27 04:47:11 user nova-compute[75260]:     <acpi/>
Nov 27 04:47:11 user nova-compute[75260]:     <apic/>
Nov 27 04:47:11 user nova-compute[75260]:     <vmcoreinfo state='on'/>
Nov 27 04:47:11 user nova-compute[75260]:   </features>
Nov 27 04:47:11 user nova-compute[75260]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 04:47:11 user nova-compute[75260]:     <model fallback='forbid'>Nehalem</model>
Nov 27 04:47:11 user nova-compute[75260]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 04:47:11 user nova-compute[75260]:     <feature policy='require' name='vme'/>
Nov 27 04:47:11 user nova-compute[75260]:     <feature policy='require' name='x2apic'/>
Nov 27 04:47:11 user nova-compute[75260]:     <feature policy='require' name='hypervisor'/>
Nov 27 04:47:11 user nova-compute[75260]:   </cpu>
Nov 27 04:47:11 user nova-compute[75260]:   <clock offset='utc'>
Nov 27 04:47:11 user nova-compute[75260]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 04:47:11 user nova-compute[75260]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 04:47:11 user nova-compute[75260]:     <timer name='hpet' present='no'/>
Nov 27 04:47:11 user nova-compute[75260]:   </clock>
Nov 27 04:47:11 user nova-compute[75260]:   <on_poweroff>destroy</on_poweroff>
Nov 27 04:47:11 user nova-compute[75260]:   <on_reboot>restart</on_reboot>
Nov 27 04:47:11 user nova-compute[75260]:   <on_crash>destroy</on_crash>
Nov 27 04:47:11 user nova-compute[75260]:   <devices>
Nov 27 04:47:11 user nova-compute[75260]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 04:47:11 user nova-compute[75260]:     <disk type='file' device='disk'>
Nov 27 04:47:11 user nova-compute[75260]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 04:47:11 user nova-compute[75260]:       <source file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk' index='2'/>
Nov 27 04:47:11 user nova-compute[75260]:       <backingStore type='file' index='3'>
Nov 27 04:47:11 user nova-compute[75260]:         <format type='raw'/>
Nov 27 04:47:11 user nova-compute[75260]:         <source file='/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86'/>
Nov 27 04:47:11 user nova-compute[75260]:         <backingStore/>
Nov 27 04:47:11 user nova-compute[75260]:       </backingStore>
Nov 27 04:47:11 user nova-compute[75260]:       <target dev='vda' bus='virtio'/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='virtio-disk0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </disk>
Nov 27 04:47:11 user nova-compute[75260]:     <disk type='file' device='cdrom'>
Nov 27 04:47:11 user nova-compute[75260]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 04:47:11 user nova-compute[75260]:       <source file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/disk.config' index='1'/>
Nov 27 04:47:11 user nova-compute[75260]:       <backingStore/>
Nov 27 04:47:11 user nova-compute[75260]:       <target dev='hda' bus='ide'/>
Nov 27 04:47:11 user nova-compute[75260]:       <readonly/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='ide0-0-0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </disk>
Nov 27 04:47:11 user nova-compute[75260]:     <controller type='usb' index='0' model='none'>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='usb'/>
Nov 27 04:47:11 user nova-compute[75260]:     </controller>
Nov 27 04:47:11 user nova-compute[75260]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='pci.0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </controller>
Nov 27 04:47:11 user nova-compute[75260]:     <controller type='ide' index='0'>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='ide'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 04:47:11 user nova-compute[75260]:     </controller>
Nov 27 04:47:11 user nova-compute[75260]:     <interface type='ethernet'>
Nov 27 04:47:11 user nova-compute[75260]:       <mac address='fa:16:3e:81:d6:58'/>
Nov 27 04:47:11 user nova-compute[75260]:       <target dev='tap376192b1-f7'/>
Nov 27 04:47:11 user nova-compute[75260]:       <model type='virtio'/>
Nov 27 04:47:11 user nova-compute[75260]:       <mtu size='1442'/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='net0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </interface>
Nov 27 04:47:11 user nova-compute[75260]:     <serial type='pty'>
Nov 27 04:47:11 user nova-compute[75260]:       <source path='/dev/pts/9'/>
Nov 27 04:47:11 user nova-compute[75260]:       <log file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/console.log' append='off'/>
Nov 27 04:47:11 user nova-compute[75260]:       <target type='isa-serial' port='0'>
Nov 27 04:47:11 user nova-compute[75260]:         <model name='isa-serial'/>
Nov 27 04:47:11 user nova-compute[75260]:       </target>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='serial0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </serial>
Nov 27 04:47:11 user nova-compute[75260]:     <console type='pty' tty='/dev/pts/9'>
Nov 27 04:47:11 user nova-compute[75260]:       <source path='/dev/pts/9'/>
Nov 27 04:47:11 user nova-compute[75260]:       <log file='/opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5/console.log' append='off'/>
Nov 27 04:47:11 user nova-compute[75260]:       <target type='serial' port='0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='serial0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </console>
Nov 27 04:47:11 user nova-compute[75260]:     <input type='mouse' bus='ps2'>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='input0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </input>
Nov 27 04:47:11 user nova-compute[75260]:     <input type='keyboard' bus='ps2'>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='input1'/>
Nov 27 04:47:11 user nova-compute[75260]:     </input>
Nov 27 04:47:11 user nova-compute[75260]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 27 04:47:11 user nova-compute[75260]:       <listen type='address' address='0.0.0.0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </graphics>
Nov 27 04:47:11 user nova-compute[75260]:     <audio id='1' type='none'/>
Nov 27 04:47:11 user nova-compute[75260]:     <video>
Nov 27 04:47:11 user nova-compute[75260]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='video0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </video>
Nov 27 04:47:11 user nova-compute[75260]:     <memballoon model='virtio'>
Nov 27 04:47:11 user nova-compute[75260]:       <stats period='10'/>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='balloon0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </memballoon>
Nov 27 04:47:11 user nova-compute[75260]:     <rng model='virtio'>
Nov 27 04:47:11 user nova-compute[75260]:       <backend model='random'>/dev/urandom</backend>
Nov 27 04:47:11 user nova-compute[75260]:       <alias name='rng0'/>
Nov 27 04:47:11 user nova-compute[75260]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 04:47:11 user nova-compute[75260]:     </rng>
Nov 27 04:47:11 user nova-compute[75260]:   </devices>
Nov 27 04:47:11 user nova-compute[75260]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 04:47:11 user nova-compute[75260]:     <label>libvirt-1100294c-ea5b-4994-885d-47357e7802c5</label>
Nov 27 04:47:11 user nova-compute[75260]:     <imagelabel>libvirt-1100294c-ea5b-4994-885d-47357e7802c5</imagelabel>
Nov 27 04:47:11 user nova-compute[75260]:   </seclabel>
Nov 27 04:47:11 user nova-compute[75260]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 04:47:11 user nova-compute[75260]:     <label>+64055:+108</label>
Nov 27 04:47:11 user nova-compute[75260]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 04:47:11 user nova-compute[75260]:   </seclabel>
Nov 27 04:47:11 user nova-compute[75260]: </domain>
Nov 27 04:47:11 user nova-compute[75260]:  {{(pid=75260) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 04:47:11 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Detaching interface fa:16:3e:b1:89:a3 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap45b06fa0-87' not found.
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717557176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717557176',id=18,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW/qZPhLS1C8EQqzaoylt+DfXolIsqNuC0floaWTwm9Y8Kc2f0NOU/7QWq7h0reHBPBKp0h7iYnCXj4HbSmbHm1/Ah0OwOQu0068/YZcZc3v7umKCkKAxw0WIQGACGtqg==',key_name='tempest-keypair-875505160',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d9acefde97437abee0beaae079fcd9',ramdisk_id='',reservation_id='r-sco77w29',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-682424273',owner_user_name='tempest-TaggedAttachmentsTest-682424273-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a463d6bb05e471c9dfaf686d06202e1',uuid=1100294c-ea5b-4994-885d-47357e7802c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.network.os_vif_util [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] Converting VIF {"id": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "address": "fa:16:3e:b1:89:a3", "network": {"id": "6e96c77a-3c83-4bc1-b3da-e1141695e246", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1749353852", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b06fa0-87", "ovs_interfaceid": "45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.network.os_vif_util [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG os_vif [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45b06fa0-87, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:47:11 user nova-compute[75260]: INFO os_vif [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:89:a3,bridge_name='br-int',has_traffic_filtering=True,id=45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e,network=Network(6e96c77a-3c83-4bc1-b3da-e1141695e246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b06fa0-87')
Nov 27 04:47:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [req-9848cbfc-57b7-4c7e-804c-ef0df753a18b req-eabfe06b-125c-4ec7-bc43-b7ab180df2db service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:47:11 user nova-compute[75260]:   <nova:package version="0.0.0"/>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:name>tempest-device-tagging-server-717557176</nova:name>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:creationTime>2023-11-27 04:47:11</nova:creationTime>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:flavor name="m1.tiny">
Nov 27 04:47:11 user nova-compute[75260]:     <nova:memory>512</nova:memory>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:disk>1</nova:disk>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:swap>0</nova:swap>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:vcpus>1</nova:vcpus>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:flavor>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:owner>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:user uuid="8a463d6bb05e471c9dfaf686d06202e1">tempest-TaggedAttachmentsTest-682424273-project-member</nova:user>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:project uuid="a3d9acefde97437abee0beaae079fcd9">tempest-TaggedAttachmentsTest-682424273</nova:project>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:owner>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:47:11 user nova-compute[75260]:   <nova:ports>
Nov 27 04:47:11 user nova-compute[75260]:     <nova:port uuid="376192b1-f789-4b6f-be27-55efeb202f27">
Nov 27 04:47:11 user nova-compute[75260]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:47:11 user nova-compute[75260]:     </nova:port>
Nov 27 04:47:11 user nova-compute[75260]:   </nova:ports>
Nov 27 04:47:11 user nova-compute[75260]: </nova:instance>
Nov 27 04:47:11 user nova-compute[75260]:  {{(pid=75260) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 27 04:47:12 user nova-compute[75260]: DEBUG nova.network.neutron [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updating instance_info_cache with network_info: [{"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Releasing lock "refresh_cache-1100294c-ea5b-4994-885d-47357e7802c5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:47:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6c03c219-7d66-4278-93ae-b2d5e1df65de tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "interface-1100294c-ea5b-4994-885d-47357e7802c5-45b06fa0-87f1-41f8-8f5a-f4d305aa7e5e" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.500s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:47:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:47:15 user nova-compute[75260]: INFO nova.compute.claims [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Claim successful on node user
Nov 27 04:47:15 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:47:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG nova.network.neutron [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:47:16 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:47:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG nova.policy [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41069f4d1d404da19dcfb2a3552fcddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5f7694b2294e16aec0248f1217b148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:47:16 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Creating image(s)
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk 1073741824" returned: 0 in 0.046s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG nova.network.neutron [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Successfully created port: e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:47:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Cannot resize image /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Ensure instance console log exists: /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.network.neutron [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Successfully updated port: e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquired lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.network.neutron [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-83bf10e6-a177-4049-8d49-c5e94cd70e7b req-d3c8ae26-7096-4187-b39b-b336a7ea6cc3 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-changed-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-83bf10e6-a177-4049-8d49-c5e94cd70e7b req-d3c8ae26-7096-4187-b39b-b336a7ea6cc3 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Refreshing instance network info cache due to event network-changed-e8622473-aed7-41ef-923e-b8565a6783c2. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-83bf10e6-a177-4049-8d49-c5e94cd70e7b req-d3c8ae26-7096-4187-b39b-b336a7ea6cc3 service nova] Acquiring lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.network.neutron [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.network.neutron [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updating instance_info_cache with network_info: [{"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Releasing lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Instance network_info: |[{"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-83bf10e6-a177-4049-8d49-c5e94cd70e7b req-d3c8ae26-7096-4187-b39b-b336a7ea6cc3 service nova] Acquired lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.network.neutron [req-83bf10e6-a177-4049-8d49-c5e94cd70e7b req-d3c8ae26-7096-4187-b39b-b336a7ea6cc3 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Refreshing network info cache for port e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Start _get_guest_xml network_info=[{"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:47:17 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:47:17 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1800352952',display_name='tempest-ServerRescueNegativeTestJSON-server-1800352952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1800352952',id=25,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8+BTyfT3yhS/SbL6jWb2kqJSpemmWm+PhfuKA4OHRNL+O4piNSG2X5iPQjpz6riZ0IGRQbpghMSwbrA7MzmD26qCd+NSHWkwJtq4585JE9pls2BftHOx/1bQv4gHdvlg==',key_name='tempest-keypair-404684156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-gqbk6o4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:47:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=98005938-a919-41cd-94bb-bfc1c9f7ea04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b3:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8622473-aed7-41ef-923e-b8565a6783c2,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8622473-ae') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.objects.instance [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'pci_devices' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:47:17 user nova-compute[75260]:   <uuid>98005938-a919-41cd-94bb-bfc1c9f7ea04</uuid>
Nov 27 04:47:17 user nova-compute[75260]:   <name>instance-00000019</name>
Nov 27 04:47:17 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:47:17 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:47:17 user nova-compute[75260]:   <metadata>
Nov 27 04:47:17 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:47:17 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:47:17 user nova-compute[75260]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1800352952</nova:name>
Nov 27 04:47:17 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:47:17</nova:creationTime>
Nov 27 04:47:17 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:47:17 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:47:17 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:47:17 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:47:17 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:47:17 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:47:17 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:47:17 user nova-compute[75260]:       <nova:owner>
Nov 27 04:47:17 user nova-compute[75260]:         <nova:user uuid="41069f4d1d404da19dcfb2a3552fcddb">tempest-ServerRescueNegativeTestJSON-1319145768-project-member</nova:user>
Nov 27 04:47:17 user nova-compute[75260]:         <nova:project uuid="0e5f7694b2294e16aec0248f1217b148">tempest-ServerRescueNegativeTestJSON-1319145768</nova:project>
Nov 27 04:47:17 user nova-compute[75260]:       </nova:owner>
Nov 27 04:47:17 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:47:17 user nova-compute[75260]:       <nova:ports>
Nov 27 04:47:17 user nova-compute[75260]:         <nova:port uuid="e8622473-aed7-41ef-923e-b8565a6783c2">
Nov 27 04:47:17 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 04:47:17 user nova-compute[75260]:         </nova:port>
Nov 27 04:47:17 user nova-compute[75260]:       </nova:ports>
Nov 27 04:47:17 user nova-compute[75260]:     </nova:instance>
Nov 27 04:47:17 user nova-compute[75260]:   </metadata>
Nov 27 04:47:17 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:47:17 user nova-compute[75260]:     <system>
Nov 27 04:47:17 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:47:17 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:47:17 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:47:17 user nova-compute[75260]:       <entry name="serial">98005938-a919-41cd-94bb-bfc1c9f7ea04</entry>
Nov 27 04:47:17 user nova-compute[75260]:       <entry name="uuid">98005938-a919-41cd-94bb-bfc1c9f7ea04</entry>
Nov 27 04:47:17 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:47:17 user nova-compute[75260]:     </system>
Nov 27 04:47:17 user nova-compute[75260]:   </sysinfo>
Nov 27 04:47:17 user nova-compute[75260]:   <os>
Nov 27 04:47:17 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:47:17 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:47:17 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:47:17 user nova-compute[75260]:   </os>
Nov 27 04:47:17 user nova-compute[75260]:   <features>
Nov 27 04:47:17 user nova-compute[75260]:     <acpi/>
Nov 27 04:47:17 user nova-compute[75260]:     <apic/>
Nov 27 04:47:17 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:47:17 user nova-compute[75260]:   </features>
Nov 27 04:47:17 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:47:17 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:47:17 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:47:17 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:47:17 user nova-compute[75260]:   </clock>
Nov 27 04:47:17 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:47:17 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:47:17 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:47:17 user nova-compute[75260]:   </cpu>
Nov 27 04:47:17 user nova-compute[75260]:   <devices>
Nov 27 04:47:17 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:47:17 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:47:17 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk"/>
Nov 27 04:47:17 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:47:17 user nova-compute[75260]:     </disk>
Nov 27 04:47:17 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:47:17 user nova-compute[75260]:       <mac address="fa:16:3e:06:b3:7b"/>
Nov 27 04:47:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:47:17 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:47:17 user nova-compute[75260]:       <target dev="tape8622473-ae"/>
Nov 27 04:47:17 user nova-compute[75260]:     </interface>
Nov 27 04:47:17 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:47:17 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/console.log" append="off"/>
Nov 27 04:47:17 user nova-compute[75260]:     </serial>
Nov 27 04:47:17 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:47:17 user nova-compute[75260]:     <video>
Nov 27 04:47:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:47:17 user nova-compute[75260]:     </video>
Nov 27 04:47:17 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:47:17 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:47:17 user nova-compute[75260]:     </rng>
Nov 27 04:47:17 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:47:17 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:47:17 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:47:17 user nova-compute[75260]:     </memballoon>
Nov 27 04:47:17 user nova-compute[75260]:   </devices>
Nov 27 04:47:17 user nova-compute[75260]: </domain>
Nov 27 04:47:17 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1800352952',display_name='tempest-ServerRescueNegativeTestJSON-server-1800352952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1800352952',id=25,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8+BTyfT3yhS/SbL6jWb2kqJSpemmWm+PhfuKA4OHRNL+O4piNSG2X5iPQjpz6riZ0IGRQbpghMSwbrA7MzmD26qCd+NSHWkwJtq4585JE9pls2BftHOx/1bQv4gHdvlg==',key_name='tempest-keypair-404684156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-gqbk6o4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:47:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=98005938-a919-41cd-94bb-bfc1c9f7ea04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b3:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8622473-aed7-41ef-923e-b8565a6783c2,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8622473-ae') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG os_vif [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b3:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8622473-aed7-41ef-923e-b8565a6783c2,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8622473-ae') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d8aaa05-6ed3-516a-8382-c6c35c317aaa', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8622473-ae, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8622473-ae, col_values=(('qos', UUID('8f98febd-2920-451e-b363-a305ad62c7c1')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8622473-ae, col_values=(('external_ids', {'iface-id': 'e8622473-aed7-41ef-923e-b8565a6783c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:b3:7b', 'vm-uuid': '98005938-a919-41cd-94bb-bfc1c9f7ea04'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:47:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:17 user nova-compute[75260]: INFO os_vif [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b3:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8622473-aed7-41ef-923e-b8565a6783c2,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8622473-ae')
Nov 27 04:47:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:47:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No VIF found with MAC fa:16:3e:06:b3:7b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:47:18 user nova-compute[75260]: DEBUG nova.network.neutron [req-83bf10e6-a177-4049-8d49-c5e94cd70e7b req-d3c8ae26-7096-4187-b39b-b336a7ea6cc3 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updated VIF entry in instance network info cache for port e8622473-aed7-41ef-923e-b8565a6783c2. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:47:18 user nova-compute[75260]: DEBUG nova.network.neutron [req-83bf10e6-a177-4049-8d49-c5e94cd70e7b req-d3c8ae26-7096-4187-b39b-b336a7ea6cc3 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updating instance_info_cache with network_info: [{"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-83bf10e6-a177-4049-8d49-c5e94cd70e7b req-d3c8ae26-7096-4187-b39b-b336a7ea6cc3 service nova] Releasing lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:47:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-8bb506d7-e633-4ee7-84cb-61eea568c5b3 req-85df068f-a052-4391-8ddf-79b6f5c8a497 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bb506d7-e633-4ee7-84cb-61eea568c5b3 req-85df068f-a052-4391-8ddf-79b6f5c8a497 service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bb506d7-e633-4ee7-84cb-61eea568c5b3 req-85df068f-a052-4391-8ddf-79b6f5c8a497 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bb506d7-e633-4ee7-84cb-61eea568c5b3 req-85df068f-a052-4391-8ddf-79b6f5c8a497 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-8bb506d7-e633-4ee7-84cb-61eea568c5b3 req-85df068f-a052-4391-8ddf-79b6f5c8a497 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:47:19 user nova-compute[75260]: WARNING nova.compute.manager [req-8bb506d7-e633-4ee7-84cb-61eea568c5b3 req-85df068f-a052-4391-8ddf-79b6f5c8a497 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state building and task_state spawning.
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:47:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Instance spawned successfully.
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:47:21 user nova-compute[75260]: INFO nova.compute.manager [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:47:21 user nova-compute[75260]: INFO nova.compute.manager [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Took 6.18 seconds to build instance.
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:47:21 user nova-compute[75260]: WARNING nova.compute.manager [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state active and task_state None.
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received event network-changed-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Refreshing instance network info cache due to event network-changed-16903aa8-5484-4e72-a5e6-888a35864372. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] Acquiring lock "refresh_cache-d732c23b-281e-44db-8af0-26d045278b80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] Acquired lock "refresh_cache-d732c23b-281e-44db-8af0-26d045278b80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG nova.network.neutron [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Refreshing network info cache for port 16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5b1ddc3-550a-4e51-9b9e-cc482a51265f tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.278s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:22 user nova-compute[75260]: DEBUG nova.network.neutron [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Updated VIF entry in instance network info cache for port 16903aa8-5484-4e72-a5e6-888a35864372. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:47:22 user nova-compute[75260]: DEBUG nova.network.neutron [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Updating instance_info_cache with network_info: [{"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2400e3d-a033-4f9d-a0a1-4efcc0f8745b req-734d43cd-8c06-4de9-9938-329ad13fd163 service nova] Releasing lock "refresh_cache-d732c23b-281e-44db-8af0-26d045278b80" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:47:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d732c23b-281e-44db-8af0-26d045278b80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG nova.objects.instance [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'flavor' on Instance uuid d732c23b-281e-44db-8af0-26d045278b80 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d732c23b-281e-44db-8af0-26d045278b80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:23 user nova-compute[75260]: INFO nova.compute.manager [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Attaching volume 02bc85a7-df6c-4574-863b-ea3bd1107c71 to /dev/vdb
Nov 27 04:47:23 user nova-compute[75260]: DEBUG os_brick.utils [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[acab5ef8-8150-4ea0-b1c2-51a6b32b50bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f7b33a-7f52-4fbe-a77f-3fbd9f0b48b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ef2ff7-e54b-4ba7-86cc-8b255d5c2787]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a04e1dc-e7be-485f-8cb9-9eb76e44d3cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:47:23 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:47:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d83d4-5ffc-4531-aaf4-fc25877a0f38]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG os_brick.utils [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:47:23 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Updating existing volume attachment record: c665b65c-d4a3-463e-844b-79c2bf93a70f {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:47:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:24 user nova-compute[75260]: INFO nova.compute.manager [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Terminating instance
Nov 27 04:47:24 user nova-compute[75260]: DEBUG nova.compute.manager [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:47:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-9b8197f0-53aa-4210-a0d7-e9d4e20aa6c4 req-c94905ff-978c-4ba6-a319-98e22eb2fe82 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Received event network-vif-unplugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b8197f0-53aa-4210-a0d7-e9d4e20aa6c4 req-c94905ff-978c-4ba6-a319-98e22eb2fe82 service nova] Acquiring lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b8197f0-53aa-4210-a0d7-e9d4e20aa6c4 req-c94905ff-978c-4ba6-a319-98e22eb2fe82 service nova] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b8197f0-53aa-4210-a0d7-e9d4e20aa6c4 req-c94905ff-978c-4ba6-a319-98e22eb2fe82 service nova] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-9b8197f0-53aa-4210-a0d7-e9d4e20aa6c4 req-c94905ff-978c-4ba6-a319-98e22eb2fe82 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] No waiting events found dispatching network-vif-unplugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-9b8197f0-53aa-4210-a0d7-e9d4e20aa6c4 req-c94905ff-978c-4ba6-a319-98e22eb2fe82 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Received event network-vif-unplugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Instance destroyed successfully.
Nov 27 04:47:25 user nova-compute[75260]: DEBUG nova.objects.instance [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lazy-loading 'resources' on Instance uuid 30d6ebaa-7c35-4eeb-8a06-789e691fbf08 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1716276371',display_name='tempest-ServersNegativeTestJSON-server-1716276371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1716276371',id=22,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2fd7cc4144d4422a140157d994f8c06',ramdisk_id='',reservation_id='r-r87c0c0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1694781308',owner_user_name='tempest-ServersNegativeTestJSON-1694781308-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:45:41Z,user_data=None,user_id='1f5e727696d94f35a7f111cfa01a2530',uuid=30d6ebaa-7c35-4eeb-8a06-789e691fbf08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "address": "fa:16:3e:79:18:c8", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0093ecb2-78", "ovs_interfaceid": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converting VIF {"id": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "address": "fa:16:3e:79:18:c8", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0093ecb2-78", "ovs_interfaceid": "0093ecb2-78ec-4a7e-ba61-7b542b0d9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:c8,bridge_name='br-int',has_traffic_filtering=True,id=0093ecb2-78ec-4a7e-ba61-7b542b0d9020,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0093ecb2-78') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG os_vif [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:c8,bridge_name='br-int',has_traffic_filtering=True,id=0093ecb2-78ec-4a7e-ba61-7b542b0d9020,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0093ecb2-78') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0093ecb2-78, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6145b284-d191-42c4-b18a-b1374e45e759) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:47:25 user nova-compute[75260]: INFO os_vif [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:18:c8,bridge_name='br-int',has_traffic_filtering=True,id=0093ecb2-78ec-4a7e-ba61-7b542b0d9020,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0093ecb2-78')
Nov 27 04:47:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Deleting instance files /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08_del
Nov 27 04:47:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Deletion of /opt/stack/data/nova/instances/30d6ebaa-7c35-4eeb-8a06-789e691fbf08_del complete
Nov 27 04:47:25 user nova-compute[75260]: INFO nova.compute.manager [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 27 04:47:25 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:47:25 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:47:26 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:26 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Took 0.50 seconds to deallocate network for instance.
Nov 27 04:47:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:26 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:47:26 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:47:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:26 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Deleted allocations for instance 30d6ebaa-7c35-4eeb-8a06-789e691fbf08
Nov 27 04:47:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77a9c33b-8a2c-4245-9192-56f689d6a5ac tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.072s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-9ea0afcb-52a5-4a51-9f13-cf6a2f2617c3 req-78ceef43-e0f0-4464-924b-ed24d2599f06 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Received event network-vif-plugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9ea0afcb-52a5-4a51-9f13-cf6a2f2617c3 req-78ceef43-e0f0-4464-924b-ed24d2599f06 service nova] Acquiring lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9ea0afcb-52a5-4a51-9f13-cf6a2f2617c3 req-78ceef43-e0f0-4464-924b-ed24d2599f06 service nova] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9ea0afcb-52a5-4a51-9f13-cf6a2f2617c3 req-78ceef43-e0f0-4464-924b-ed24d2599f06 service nova] Lock "30d6ebaa-7c35-4eeb-8a06-789e691fbf08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-9ea0afcb-52a5-4a51-9f13-cf6a2f2617c3 req-78ceef43-e0f0-4464-924b-ed24d2599f06 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] No waiting events found dispatching network-vif-plugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:47:27 user nova-compute[75260]: WARNING nova.compute.manager [req-9ea0afcb-52a5-4a51-9f13-cf6a2f2617c3 req-78ceef43-e0f0-4464-924b-ed24d2599f06 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Received unexpected event network-vif-plugged-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 for instance with vm_state deleted and task_state None.
Nov 27 04:47:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-9ea0afcb-52a5-4a51-9f13-cf6a2f2617c3 req-78ceef43-e0f0-4464-924b-ed24d2599f06 service nova] [instance: 30d6ebaa-7c35-4eeb-8a06-789e691fbf08] Received event network-vif-deleted-0093ecb2-78ec-4a7e-ba61-7b542b0d9020 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvMCiWQH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:47:30 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:47:30 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:47:30 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fcd585-0721-4fd6-84f3-6c82cde8f95d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:47:30 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e323d7c-a95b-459b-93b6-60a31114af51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71] added
Nov 27 04:47:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5512e1-75ae-4504-ab21-d8a8d1c3b0cd]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c12eedd-e632-400d-9a95-006107ae5578]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvMCiWQH {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvMCiWQH" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[27be7549-7935-41eb-af49-4e4cd067acc5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gvMCiWQH'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6543a8a6-d2af-4368-afd8-917c75e8306d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5d8a9d-e1aa-40a7-9e7a-92e8f326ed0f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:47:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:47:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bae1b7-ef13-461d-8c16-0b92ffd73c79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71, portal: 172.16.0.220,3260]
Nov 27 04:47:30 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71, portal: 172.16.0.220,3260] successful.
Nov 27 04:47:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d609de-363a-463b-a6d3-7a0091bd6672]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[803b3a48-a2c4-4d96-972d-cefb31c2b115]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:47:30 user nova-compute[75260]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 (non-flash)
Nov 27 04:47:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:47:30 user nova-compute[75260]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 (non-flash)
Nov 27 04:47:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f7590-6157-4d55-97ee-08ca0e420f6d]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:47:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvMCiWQH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23766613663613462', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766613663613462', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG nova.objects.instance [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'flavor' on Instance uuid d732c23b-281e-44db-8af0-26d045278b80 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:47:31 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:47:31 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:47:31 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:47:31 user nova-compute[75260]:   <serial>02bc85a7-df6c-4574-863b-ea3bd1107c71</serial>
Nov 27 04:47:31 user nova-compute[75260]: </disk>
Nov 27 04:47:31 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:47:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No VIF found with MAC fa:16:3e:cb:26:49, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:47:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0b81e956-dd36-47df-8d29-d91b476a0c8a tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.892s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d732c23b-281e-44db-8af0-26d045278b80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:33 user nova-compute[75260]: INFO nova.compute.manager [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Detaching volume 02bc85a7-df6c-4574-863b-ea3bd1107c71
Nov 27 04:47:33 user nova-compute[75260]: INFO nova.virt.block_device [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Attempting to driver detach volume 02bc85a7-df6c-4574-863b-ea3bd1107c71 from mountpoint /dev/vdb
Nov 27 04:47:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Attempting to detach device vdb from instance d732c23b-281e-44db-8af0-26d045278b80 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:47:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:47:33 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:47:33 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:47:33 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:47:33 user nova-compute[75260]:   <serial>02bc85a7-df6c-4574-863b-ea3bd1107c71</serial>
Nov 27 04:47:33 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:47:33 user nova-compute[75260]: </disk>
Nov 27 04:47:33 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:47:33 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully detached device vdb from instance d732c23b-281e-44db-8af0-26d045278b80 from the persistent domain config.
Nov 27 04:47:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d732c23b-281e-44db-8af0-26d045278b80 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:47:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:47:33 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:47:33 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:47:33 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:47:33 user nova-compute[75260]:   <serial>02bc85a7-df6c-4574-863b-ea3bd1107c71</serial>
Nov 27 04:47:33 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:47:33 user nova-compute[75260]: </disk>
Nov 27 04:47:33 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:47:33 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d732c23b-281e-44db-8af0-26d045278b80 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:35 user nova-compute[75260]: INFO nova.compute.manager [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Terminating instance
Nov 27 04:47:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG nova.compute.manager [req-ab1016ca-ae34-4f0d-8a17-c3efb2055b57 req-82f0f8a3-ac2a-47a7-920c-2e844451c7cd service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-unplugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ab1016ca-ae34-4f0d-8a17-c3efb2055b57 req-82f0f8a3-ac2a-47a7-920c-2e844451c7cd service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ab1016ca-ae34-4f0d-8a17-c3efb2055b57 req-82f0f8a3-ac2a-47a7-920c-2e844451c7cd service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ab1016ca-ae34-4f0d-8a17-c3efb2055b57 req-82f0f8a3-ac2a-47a7-920c-2e844451c7cd service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG nova.compute.manager [req-ab1016ca-ae34-4f0d-8a17-c3efb2055b57 req-82f0f8a3-ac2a-47a7-920c-2e844451c7cd service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-unplugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:47:35 user nova-compute[75260]: DEBUG nova.compute.manager [req-ab1016ca-ae34-4f0d-8a17-c3efb2055b57 req-82f0f8a3-ac2a-47a7-920c-2e844451c7cd service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-unplugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:47:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Instance destroyed successfully.
Nov 27 04:47:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lazy-loading 'resources' on Instance uuid 3d96ab7b-3690-424e-96da-5e69b1bb1e90 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1986422466',display_name='tempest-ServerActionsTestOtherB-server-1986422466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1986422466',id=5,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFB4NlyIkvuSkKdp9SCBvCksg0T5Mnmhzu1gg97fKizA6KbOPtAhyX+dbdgThddRNEEVcx1W9A9Raajm8WlZrhxaZj1ByekP4XOJKsLxLKWygxJTACdG4AQr3SivYfkcQ==',key_name='tempest-keypair-1211691950',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2dd8fd68d8c94c95908b4cd7c80082d5',ramdisk_id='',reservation_id='r-sfca6us3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1382636293',owner_user_name='tempest-ServerActionsTestOtherB-1382636293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:45:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a14d60620b674141a4f714eac61c29d5',uuid=3d96ab7b-3690-424e-96da-5e69b1bb1e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converting VIF {"id": "6cb5862a-fc82-4f80-820f-02082def752d", "address": "fa:16:3e:aa:95:ab", "network": {"id": "2d69f703-6697-4b89-9af3-02af250aaa82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1236435616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd8fd68d8c94c95908b4cd7c80082d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb5862a-fc", "ovs_interfaceid": "6cb5862a-fc82-4f80-820f-02082def752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_vif [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cb5862a-fc, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1612ed45-00bf-4bcf-bf06-d06ec39ce553) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:36 user nova-compute[75260]: INFO os_vif [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:95:ab,bridge_name='br-int',has_traffic_filtering=True,id=6cb5862a-fc82-4f80-820f-02082def752d,network=Network(2d69f703-6697-4b89-9af3-02af250aaa82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb5862a-fc')
Nov 27 04:47:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXmcrsSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:47:36 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb933e98-243d-4921-b951-1964d376eeb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:47:36 user nova-compute[75260]: No targets found.
Nov 27 04:47:36 user nova-compute[75260]: iSNS:
Nov 27 04:47:36 user nova-compute[75260]: No targets found.
Nov 27 04:47:36 user nova-compute[75260]: STATIC:
Nov 27 04:47:36 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71
Nov 27 04:47:36 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:47:36 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:47:36 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f
Nov 27 04:47:36 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:47:36 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:47:36 user nova-compute[75260]: FIRMWARE:
Nov 27 04:47:36 user nova-compute[75260]: No targets found.
Nov 27 04:47:36 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:47:36 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:47:36 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fb64b9-768e-4cb7-b2e0-0bc030791c79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df515cd-c5b4-4989-bec4-71e038130d6f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:47:36 user nova-compute[75260]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 (non-flash)
Nov 27 04:47:36 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f (non-flash)
Nov 27 04:47:36 user nova-compute[75260]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 (non-flash)
Nov 27 04:47:36 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb544a1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5811323-a3eb-4736-89cf-8499fbbb24b1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9338a84e-1656-419d-9865-e5cfa9054c44]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfd98e9-bb5f-4909-8540-0638dc3a061d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dba696d-62e5-4c1e-aac4-3fb8e702dce9]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[727797df-2175-4563-a170-756750f730ad]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5764c9c-9864-483a-a59b-73db6bda0d16]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260]
Nov 27 04:47:36 user nova-compute[75260]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f, portal: 172.16.0.220,3260] successful.
Nov 27 04:47:36 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c204d7-0a62-4fec-bba4-635ccecba25f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7897ea98-f751-46c8-baad-4caacff96a0a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] <== disconnect_volume: return (277ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:47:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Deleting instance files /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90_del
Nov 27 04:47:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Deletion of /opt/stack/data/nova/instances/3d96ab7b-3690-424e-96da-5e69b1bb1e90_del complete
Nov 27 04:47:36 user nova-compute[75260]: INFO nova.compute.manager [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 27 04:47:36 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:47:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:37 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:37 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Took 0.73 seconds to deallocate network for instance.
Nov 27 04:47:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-f7558e2e-5e13-416b-8bb0-bb91faa71236 req-54d6c54a-a1d6-4d7a-94db-63e3b950f893 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-deleted-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-3722aca7-5062-4db5-803f-644c1fa3ea94 req-8742019f-77ef-4899-a5ab-d4fa49b2c622 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3722aca7-5062-4db5-803f-644c1fa3ea94 req-8742019f-77ef-4899-a5ab-d4fa49b2c622 service nova] Acquiring lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3722aca7-5062-4db5-803f-644c1fa3ea94 req-8742019f-77ef-4899-a5ab-d4fa49b2c622 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3722aca7-5062-4db5-803f-644c1fa3ea94 req-8742019f-77ef-4899-a5ab-d4fa49b2c622 service nova] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-3722aca7-5062-4db5-803f-644c1fa3ea94 req-8742019f-77ef-4899-a5ab-d4fa49b2c622 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] No waiting events found dispatching network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:47:37 user nova-compute[75260]: WARNING nova.compute.manager [req-3722aca7-5062-4db5-803f-644c1fa3ea94 req-8742019f-77ef-4899-a5ab-d4fa49b2c622 service nova] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Received unexpected event network-vif-plugged-6cb5862a-fc82-4f80-820f-02082def752d for instance with vm_state active and task_state deleting.
Nov 27 04:47:38 user nova-compute[75260]: INFO nova.compute.manager [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] [instance: 3d96ab7b-3690-424e-96da-5e69b1bb1e90] Took 0.78 seconds to detach 1 volumes for instance.
Nov 27 04:47:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:38 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:47:38 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:47:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:38 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Deleted allocations for instance 3d96ab7b-3690-424e-96da-5e69b1bb1e90
Nov 27 04:47:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bdeb5792-56d4-45cb-8c85-0d93e46b96cf tempest-ServerActionsTestOtherB-1382636293 tempest-ServerActionsTestOtherB-1382636293-project-member] Lock "3d96ab7b-3690-424e-96da-5e69b1bb1e90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.290s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:39 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:47:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:39 user nova-compute[75260]: INFO nova.compute.manager [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Terminating instance
Nov 27 04:47:39 user nova-compute[75260]: DEBUG nova.compute.manager [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:47:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG nova.compute.manager [req-f73a24c6-cd15-466f-9aae-245c2fc76fdb req-4e77b244-b931-4eed-aaa7-592c9653f5d2 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received event network-vif-unplugged-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f73a24c6-cd15-466f-9aae-245c2fc76fdb req-4e77b244-b931-4eed-aaa7-592c9653f5d2 service nova] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f73a24c6-cd15-466f-9aae-245c2fc76fdb req-4e77b244-b931-4eed-aaa7-592c9653f5d2 service nova] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f73a24c6-cd15-466f-9aae-245c2fc76fdb req-4e77b244-b931-4eed-aaa7-592c9653f5d2 service nova] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG nova.compute.manager [req-f73a24c6-cd15-466f-9aae-245c2fc76fdb req-4e77b244-b931-4eed-aaa7-592c9653f5d2 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] No waiting events found dispatching network-vif-unplugged-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG nova.compute.manager [req-f73a24c6-cd15-466f-9aae-245c2fc76fdb req-4e77b244-b931-4eed-aaa7-592c9653f5d2 service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received event network-vif-unplugged-616206c9-3674-4232-a547-4442283b73ad for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Instance destroyed successfully.
Nov 27 04:47:40 user nova-compute[75260]: DEBUG nova.objects.instance [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lazy-loading 'resources' on Instance uuid 27a9c97c-e6f7-492a-808e-d3a62a57092f {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-386650541',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-386650541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3866505',id=20,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD99VbqL0wpTpGm93RO4qwRrWWTAlWaodgDDU/GN8NJ3snzV0CQ6/B3oru6wzTiVBN8Hchiy0ilW7Cm0VXILf5rGI98gBt1kM25vhtdR5rP1XJ70sKrVAmKIQtbQ0hdOXw==',key_name='tempest-keypair-487185593',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:44:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e0f49debbfb4bc080ebad0d891ae631',ramdisk_id='',reservation_id='r-xf2fycap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679771420',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f65b50ae21f64a9485aa04e5eb0b0be1',uuid=27a9c97c-e6f7-492a-808e-d3a62a57092f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Converting VIF {"id": "616206c9-3674-4232-a547-4442283b73ad", "address": "fa:16:3e:2e:d8:c0", "network": {"id": "ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1256171453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e0f49debbfb4bc080ebad0d891ae631", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616206c9-36", "ovs_interfaceid": "616206c9-3674-4232-a547-4442283b73ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=616206c9-3674-4232-a547-4442283b73ad,network=Network(ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616206c9-36') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG os_vif [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=616206c9-3674-4232-a547-4442283b73ad,network=Network(ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616206c9-36') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap616206c9-36, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2a7ce0b-5107-4e80-ae1f-b88a5e4c6c5c) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:47:40 user nova-compute[75260]: INFO os_vif [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:d8:c0,bridge_name='br-int',has_traffic_filtering=True,id=616206c9-3674-4232-a547-4442283b73ad,network=Network(ba8244a2-4f8c-4aaf-8795-ca9b6a51cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616206c9-36')
Nov 27 04:47:40 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Deleting instance files /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f_del
Nov 27 04:47:40 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Deletion of /opt/stack/data/nova/instances/27a9c97c-e6f7-492a-808e-d3a62a57092f_del complete
Nov 27 04:47:40 user nova-compute[75260]: INFO nova.compute.manager [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 27 04:47:40 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:47:40 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:41 user nova-compute[75260]: INFO nova.compute.manager [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Terminating instance
Nov 27 04:47:41 user nova-compute[75260]: DEBUG nova.compute.manager [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-a65cd1e2-2f79-4d03-9538-b62aa13d4798 req-76088e16-0398-4b08-89b0-45254971d88b service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-unplugged-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a65cd1e2-2f79-4d03-9538-b62aa13d4798 req-76088e16-0398-4b08-89b0-45254971d88b service nova] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a65cd1e2-2f79-4d03-9538-b62aa13d4798 req-76088e16-0398-4b08-89b0-45254971d88b service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a65cd1e2-2f79-4d03-9538-b62aa13d4798 req-76088e16-0398-4b08-89b0-45254971d88b service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-a65cd1e2-2f79-4d03-9538-b62aa13d4798 req-76088e16-0398-4b08-89b0-45254971d88b service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] No waiting events found dispatching network-vif-unplugged-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:47:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-a65cd1e2-2f79-4d03-9538-b62aa13d4798 req-76088e16-0398-4b08-89b0-45254971d88b service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-unplugged-376192b1-f789-4b6f-be27-55efeb202f27 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:42 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Took 1.39 seconds to deallocate network for instance.
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.compute.manager [req-6eeed315-fbbf-4f73-b652-7ab0191e66cc req-d6439525-717c-49b4-92d9-16fdc44bc41b service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received event network-vif-deleted-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:42 user nova-compute[75260]: INFO nova.compute.manager [req-6eeed315-fbbf-4f73-b652-7ab0191e66cc req-d6439525-717c-49b4-92d9-16fdc44bc41b service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Neutron deleted interface 616206c9-3674-4232-a547-4442283b73ad; detaching it from the instance and deleting it from the info cache
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.network.neutron [req-6eeed315-fbbf-4f73-b652-7ab0191e66cc req-d6439525-717c-49b4-92d9-16fdc44bc41b service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:42 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Instance destroyed successfully.
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.objects.instance [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lazy-loading 'resources' on Instance uuid 1100294c-ea5b-4994-885d-47357e7802c5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.compute.manager [req-6eeed315-fbbf-4f73-b652-7ab0191e66cc req-d6439525-717c-49b4-92d9-16fdc44bc41b service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Detach interface failed, port_id=616206c9-3674-4232-a547-4442283b73ad, reason: Instance 27a9c97c-e6f7-492a-808e-d3a62a57092f could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T04:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-717557176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-717557176',id=18,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW/qZPhLS1C8EQqzaoylt+DfXolIsqNuC0floaWTwm9Y8Kc2f0NOU/7QWq7h0reHBPBKp0h7iYnCXj4HbSmbHm1/Ah0OwOQu0068/YZcZc3v7umKCkKAxw0WIQGACGtqg==',key_name='tempest-keypair-875505160',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d9acefde97437abee0beaae079fcd9',ramdisk_id='',reservation_id='r-sco77w29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-682424273',owner_user_name='tempest-TaggedAttachmentsTest-682424273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a463d6bb05e471c9dfaf686d06202e1',uuid=1100294c-ea5b-4994-885d-47357e7802c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converting VIF {"id": "376192b1-f789-4b6f-be27-55efeb202f27", "address": "fa:16:3e:81:d6:58", "network": {"id": "a5d65a18-0b74-4a7d-931a-ad06304caa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1852046979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d9acefde97437abee0beaae079fcd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376192b1-f7", "ovs_interfaceid": "376192b1-f789-4b6f-be27-55efeb202f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:d6:58,bridge_name='br-int',has_traffic_filtering=True,id=376192b1-f789-4b6f-be27-55efeb202f27,network=Network(a5d65a18-0b74-4a7d-931a-ad06304caa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376192b1-f7') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG os_vif [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:d6:58,bridge_name='br-int',has_traffic_filtering=True,id=376192b1-f789-4b6f-be27-55efeb202f27,network=Network(a5d65a18-0b74-4a7d-931a-ad06304caa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376192b1-f7') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap376192b1-f7, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=858f136e-c8cd-444c-aa2c-d61ff242d2d4) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:47:42 user nova-compute[75260]: INFO os_vif [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:d6:58,bridge_name='br-int',has_traffic_filtering=True,id=376192b1-f789-4b6f-be27-55efeb202f27,network=Network(a5d65a18-0b74-4a7d-931a-ad06304caa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376192b1-f7')
Nov 27 04:47:42 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Deleting instance files /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5_del
Nov 27 04:47:42 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Deletion of /opt/stack/data/nova/instances/1100294c-ea5b-4994-885d-47357e7802c5_del complete
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.compute.manager [req-693f0da8-4b6f-43cc-8622-53d0b445913a req-befca560-2b48-42eb-8f54-73187e7d00ce service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received event network-vif-plugged-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-693f0da8-4b6f-43cc-8622-53d0b445913a req-befca560-2b48-42eb-8f54-73187e7d00ce service nova] Acquiring lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-693f0da8-4b6f-43cc-8622-53d0b445913a req-befca560-2b48-42eb-8f54-73187e7d00ce service nova] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-693f0da8-4b6f-43cc-8622-53d0b445913a req-befca560-2b48-42eb-8f54-73187e7d00ce service nova] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.compute.manager [req-693f0da8-4b6f-43cc-8622-53d0b445913a req-befca560-2b48-42eb-8f54-73187e7d00ce service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] No waiting events found dispatching network-vif-plugged-616206c9-3674-4232-a547-4442283b73ad {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:47:42 user nova-compute[75260]: WARNING nova.compute.manager [req-693f0da8-4b6f-43cc-8622-53d0b445913a req-befca560-2b48-42eb-8f54-73187e7d00ce service nova] [instance: 27a9c97c-e6f7-492a-808e-d3a62a57092f] Received unexpected event network-vif-plugged-616206c9-3674-4232-a547-4442283b73ad for instance with vm_state active and task_state deleting.
Nov 27 04:47:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:42 user nova-compute[75260]: INFO nova.compute.manager [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 27 04:47:42 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:42 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Deleted allocations for instance 27a9c97c-e6f7-492a-808e-d3a62a57092f
Nov 27 04:47:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-29dfd0d3-c163-43d0-a126-1be700c36b6b tempest-TestServerVolumeAttachScenarioOldVersion-1679771420 tempest-TestServerVolumeAttachScenarioOldVersion-1679771420-project-member] Lock "27a9c97c-e6f7-492a-808e-d3a62a57092f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.885s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:42 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:43 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Took 0.81 seconds to deallocate network for instance.
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:43 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Deleted allocations for instance 1100294c-ea5b-4994-885d-47357e7802c5
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-96266fe9-9e76-4af7-97cf-1bb090ac0e63 tempest-TaggedAttachmentsTest-682424273 tempest-TaggedAttachmentsTest-682424273-project-member] Lock "1100294c-ea5b-4994-885d-47357e7802c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-04b682a8-2a2a-4148-8d3d-d512841f162d req-31e82176-ac22-42ee-a58f-c32171db97da service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-plugged-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-04b682a8-2a2a-4148-8d3d-d512841f162d req-31e82176-ac22-42ee-a58f-c32171db97da service nova] Acquiring lock "1100294c-ea5b-4994-885d-47357e7802c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-04b682a8-2a2a-4148-8d3d-d512841f162d req-31e82176-ac22-42ee-a58f-c32171db97da service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-04b682a8-2a2a-4148-8d3d-d512841f162d req-31e82176-ac22-42ee-a58f-c32171db97da service nova] Lock "1100294c-ea5b-4994-885d-47357e7802c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-04b682a8-2a2a-4148-8d3d-d512841f162d req-31e82176-ac22-42ee-a58f-c32171db97da service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] No waiting events found dispatching network-vif-plugged-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:47:43 user nova-compute[75260]: WARNING nova.compute.manager [req-04b682a8-2a2a-4148-8d3d-d512841f162d req-31e82176-ac22-42ee-a58f-c32171db97da service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received unexpected event network-vif-plugged-376192b1-f789-4b6f-be27-55efeb202f27 for instance with vm_state deleted and task_state None.
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:47:43 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-17743fce-45a4-4728-9010-b1ca91fdbc4a req-84e4aac0-5ffc-455b-8091-c34ffb1d478d service nova] [instance: 1100294c-ea5b-4994-885d-47357e7802c5] Received event network-vif-deleted-376192b1-f789-4b6f-be27-55efeb202f27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updating instance_info_cache with network_info: [{"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:44 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:48 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:47:48 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:47:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7560MB free_disk=25.524921417236328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:47:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:47:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 12efb820-12ab-442d-a5fe-80b08f12a729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d0364679-4db1-4da8-bce8-80eea41feb13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d732c23b-281e-44db-8af0-26d045278b80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-b8051133-761f-4986-ab59-d7ca63132e38 req-1f59d997-c7bc-437f-904b-f28b74fbd0ef service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-changed-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-b8051133-761f-4986-ab59-d7ca63132e38 req-1f59d997-c7bc-437f-904b-f28b74fbd0ef service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Refreshing instance network info cache due to event network-changed-08fcec14-f146-4deb-861b-02af609bfd4e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b8051133-761f-4986-ab59-d7ca63132e38 req-1f59d997-c7bc-437f-904b-f28b74fbd0ef service nova] Acquiring lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b8051133-761f-4986-ab59-d7ca63132e38 req-1f59d997-c7bc-437f-904b-f28b74fbd0ef service nova] Acquired lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.network.neutron [req-b8051133-761f-4986-ab59-d7ca63132e38 req-1f59d997-c7bc-437f-904b-f28b74fbd0ef service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Refreshing network info cache for port 08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.network.neutron [req-b8051133-761f-4986-ab59-d7ca63132e38 req-1f59d997-c7bc-437f-904b-f28b74fbd0ef service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updated VIF entry in instance network info cache for port 08fcec14-f146-4deb-861b-02af609bfd4e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG nova.network.neutron [req-b8051133-761f-4986-ab59-d7ca63132e38 req-1f59d997-c7bc-437f-904b-f28b74fbd0ef service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updating instance_info_cache with network_info: [{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:47:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b8051133-761f-4986-ab59-d7ca63132e38 req-1f59d997-c7bc-437f-904b-f28b74fbd0ef service nova] Releasing lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:47:50 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:47:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:47:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:47:50 user nova-compute[75260]: INFO nova.compute.manager [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] instance snapshotting
Nov 27 04:47:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Beginning live snapshot process
Nov 27 04:47:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json -f qcow2 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json -f qcow2 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuljbr683/c8724c79424c40d1aca59d56b7500990.delta 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuljbr683/c8724c79424c40d1aca59d56b7500990.delta 1073741824" returned: 0 in 0.056s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 04:47:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:47:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:47:52 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 04:47:52 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 04:47:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuljbr683/c8724c79424c40d1aca59d56b7500990.delta /opt/stack/data/nova/instances/snapshots/tmpuljbr683/c8724c79424c40d1aca59d56b7500990 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuljbr683/c8724c79424c40d1aca59d56b7500990.delta /opt/stack/data/nova/instances/snapshots/tmpuljbr683/c8724c79424c40d1aca59d56b7500990" returned: 0 in 0.403s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Snapshot extracted, beginning image upload
Nov 27 04:47:53 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d732c23b-281e-44db-8af0-26d045278b80 is timed out.
Nov 27 04:47:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully detached device vdb from instance d732c23b-281e-44db-8af0-26d045278b80 from the live domain config.
Nov 27 04:47:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvMCiWQH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:47:53 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c04a0b-6636-4043-b2be-c7d737572c5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:47:53 user nova-compute[75260]: No targets found.
Nov 27 04:47:53 user nova-compute[75260]: iSNS:
Nov 27 04:47:53 user nova-compute[75260]: No targets found.
Nov 27 04:47:53 user nova-compute[75260]: STATIC:
Nov 27 04:47:53 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71
Nov 27 04:47:53 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:47:53 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:47:53 user nova-compute[75260]: FIRMWARE:
Nov 27 04:47:53 user nova-compute[75260]: No targets found.
Nov 27 04:47:53 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:47:53 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:47:53 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3703d18-c98f-4e10-b231-2e519fbf8aef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[459e4d4d-49b7-4cc6-b6ce-8144b1203cdb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 (non-flash)
Nov 27 04:47:53 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 (non-flash)
Nov 27 04:47:53 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c213370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d571a78-f6fc-499a-989e-a5e14e9479ed]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8a9cf2-5d97-40ca-9012-c4a7ae5e888d]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:47:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a719e8c-f67d-4546-abb5-56c3c33e81d0]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c743762b-5223-4a99-8ddd-95a0007e2418]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52589ec-168c-47d6-9568-234e89e47a6a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6e2178-f18b-43d4-a41a-f21d57d9bb44]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71, portal: 172.16.0.220,3260]
Nov 27 04:47:54 user nova-compute[75260]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71, portal: 172.16.0.220,3260] successful.
Nov 27 04:47:54 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02bc85a7-df6c-4574-863b-ea3bd1107c71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e294ac1-2ced-4b9a-af1a-cd5865f1e7fb]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] <== disconnect_volume: return (293ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:47:54 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'flavor' on Instance uuid d732c23b-281e-44db-8af0-26d045278b80 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:47:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8ae31680-20da-41ca-a37b-eca7c0f5a2ab tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:47:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Snapshot image upload complete
Nov 27 04:47:55 user nova-compute[75260]: INFO nova.compute.manager [None req-9063881b-b058-4341-af76-09d9ba6cc262 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Took 5.21 seconds to snapshot the instance on the hypervisor.
Nov 27 04:47:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:47:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:10 user nova-compute[75260]: DEBUG nova.compute.manager [req-7404bb30-26b5-40da-827d-93175b03df09 req-d4313ae4-faa9-413b-8afc-c6a9b7880a44 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received event network-changed-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:48:10 user nova-compute[75260]: DEBUG nova.compute.manager [req-7404bb30-26b5-40da-827d-93175b03df09 req-d4313ae4-faa9-413b-8afc-c6a9b7880a44 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Refreshing instance network info cache due to event network-changed-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:48:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7404bb30-26b5-40da-827d-93175b03df09 req-d4313ae4-faa9-413b-8afc-c6a9b7880a44 service nova] Acquiring lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:48:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7404bb30-26b5-40da-827d-93175b03df09 req-d4313ae4-faa9-413b-8afc-c6a9b7880a44 service nova] Acquired lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:48:10 user nova-compute[75260]: DEBUG nova.network.neutron [req-7404bb30-26b5-40da-827d-93175b03df09 req-d4313ae4-faa9-413b-8afc-c6a9b7880a44 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Refreshing network info cache for port 4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:48:11 user nova-compute[75260]: DEBUG nova.network.neutron [req-7404bb30-26b5-40da-827d-93175b03df09 req-d4313ae4-faa9-413b-8afc-c6a9b7880a44 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updated VIF entry in instance network info cache for port 4fe8daac-ecc6-4b5c-99d6-b651e3c37e82. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:48:11 user nova-compute[75260]: DEBUG nova.network.neutron [req-7404bb30-26b5-40da-827d-93175b03df09 req-d4313ae4-faa9-413b-8afc-c6a9b7880a44 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updating instance_info_cache with network_info: [{"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:48:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7404bb30-26b5-40da-827d-93175b03df09 req-d4313ae4-faa9-413b-8afc-c6a9b7880a44 service nova] Releasing lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:48:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d732c23b-281e-44db-8af0-26d045278b80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "d732c23b-281e-44db-8af0-26d045278b80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:23 user nova-compute[75260]: INFO nova.compute.manager [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Terminating instance
Nov 27 04:48:23 user nova-compute[75260]: DEBUG nova.compute.manager [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:48:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-a810f649-ef25-4100-a6c1-46011bcb80ae req-7f18488a-7f38-4949-b921-edac9578ce7d service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received event network-vif-unplugged-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a810f649-ef25-4100-a6c1-46011bcb80ae req-7f18488a-7f38-4949-b921-edac9578ce7d service nova] Acquiring lock "d732c23b-281e-44db-8af0-26d045278b80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a810f649-ef25-4100-a6c1-46011bcb80ae req-7f18488a-7f38-4949-b921-edac9578ce7d service nova] Lock "d732c23b-281e-44db-8af0-26d045278b80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a810f649-ef25-4100-a6c1-46011bcb80ae req-7f18488a-7f38-4949-b921-edac9578ce7d service nova] Lock "d732c23b-281e-44db-8af0-26d045278b80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-a810f649-ef25-4100-a6c1-46011bcb80ae req-7f18488a-7f38-4949-b921-edac9578ce7d service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] No waiting events found dispatching network-vif-unplugged-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-a810f649-ef25-4100-a6c1-46011bcb80ae req-7f18488a-7f38-4949-b921-edac9578ce7d service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received event network-vif-unplugged-16903aa8-5484-4e72-a5e6-888a35864372 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:48:24 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d732c23b-281e-44db-8af0-26d045278b80] Instance destroyed successfully.
Nov 27 04:48:24 user nova-compute[75260]: DEBUG nova.objects.instance [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'resources' on Instance uuid d732c23b-281e-44db-8af0-26d045278b80 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1821962666',display_name='tempest-AttachVolumeNegativeTest-server-1821962666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1821962666',id=21,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+JrLLO++qgoTZ7krjv2mhJXv5F6m8PgCO0U41fj3bg3uksb6E9RccfCWPgAgKgGxzGHxv+xULC3gT9rGh1JvsIX6YVpqqfoEtlwnCU/HHZXxsnJkcxuwVvpSLCoDoRdg==',key_name='tempest-keypair-1954803909',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-be38f61a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=d732c23b-281e-44db-8af0-26d045278b80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "16903aa8-5484-4e72-a5e6-888a35864372", "address": "fa:16:3e:cb:26:49", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16903aa8-54", "ovs_interfaceid": "16903aa8-5484-4e72-a5e6-888a35864372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:26:49,bridge_name='br-int',has_traffic_filtering=True,id=16903aa8-5484-4e72-a5e6-888a35864372,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16903aa8-54') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG os_vif [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:26:49,bridge_name='br-int',has_traffic_filtering=True,id=16903aa8-5484-4e72-a5e6-888a35864372,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16903aa8-54') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16903aa8-54, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=464c787b-1232-48ba-9008-e414ae105108) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:24 user nova-compute[75260]: INFO os_vif [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:26:49,bridge_name='br-int',has_traffic_filtering=True,id=16903aa8-5484-4e72-a5e6-888a35864372,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16903aa8-54')
Nov 27 04:48:24 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Deleting instance files /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80_del
Nov 27 04:48:24 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Deletion of /opt/stack/data/nova/instances/d732c23b-281e-44db-8af0-26d045278b80_del complete
Nov 27 04:48:24 user nova-compute[75260]: INFO nova.compute.manager [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: d732c23b-281e-44db-8af0-26d045278b80] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 27 04:48:24 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: d732c23b-281e-44db-8af0-26d045278b80] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d732c23b-281e-44db-8af0-26d045278b80] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:48:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:25 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d732c23b-281e-44db-8af0-26d045278b80] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:48:25 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: d732c23b-281e-44db-8af0-26d045278b80] Took 0.88 seconds to deallocate network for instance.
Nov 27 04:48:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-0456d4bf-ab58-4b4f-b2e2-24330b1c5598 req-0baed764-285a-43ec-aae5-aafdc4c6577f service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received event network-vif-deleted-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:48:25 user nova-compute[75260]: INFO nova.compute.manager [req-0456d4bf-ab58-4b4f-b2e2-24330b1c5598 req-0baed764-285a-43ec-aae5-aafdc4c6577f service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Neutron deleted interface 16903aa8-5484-4e72-a5e6-888a35864372; detaching it from the instance and deleting it from the info cache
Nov 27 04:48:25 user nova-compute[75260]: DEBUG nova.network.neutron [req-0456d4bf-ab58-4b4f-b2e2-24330b1c5598 req-0baed764-285a-43ec-aae5-aafdc4c6577f service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:48:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-0456d4bf-ab58-4b4f-b2e2-24330b1c5598 req-0baed764-285a-43ec-aae5-aafdc4c6577f service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Detach interface failed, port_id=16903aa8-5484-4e72-a5e6-888a35864372, reason: Instance d732c23b-281e-44db-8af0-26d045278b80 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:48:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:25 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:48:25 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:48:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:25 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Deleted allocations for instance d732c23b-281e-44db-8af0-26d045278b80
Nov 27 04:48:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fdf33187-2522-4d61-b92d-b32c643f7b26 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "d732c23b-281e-44db-8af0-26d045278b80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.391s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-23f09690-ae96-49e1-89de-70313b7e0800 req-b2031c4b-4745-4432-b3a7-f4ed70004481 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received event network-vif-plugged-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:48:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-23f09690-ae96-49e1-89de-70313b7e0800 req-b2031c4b-4745-4432-b3a7-f4ed70004481 service nova] Acquiring lock "d732c23b-281e-44db-8af0-26d045278b80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-23f09690-ae96-49e1-89de-70313b7e0800 req-b2031c4b-4745-4432-b3a7-f4ed70004481 service nova] Lock "d732c23b-281e-44db-8af0-26d045278b80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-23f09690-ae96-49e1-89de-70313b7e0800 req-b2031c4b-4745-4432-b3a7-f4ed70004481 service nova] Lock "d732c23b-281e-44db-8af0-26d045278b80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-23f09690-ae96-49e1-89de-70313b7e0800 req-b2031c4b-4745-4432-b3a7-f4ed70004481 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] No waiting events found dispatching network-vif-plugged-16903aa8-5484-4e72-a5e6-888a35864372 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:48:26 user nova-compute[75260]: WARNING nova.compute.manager [req-23f09690-ae96-49e1-89de-70313b7e0800 req-b2031c4b-4745-4432-b3a7-f4ed70004481 service nova] [instance: d732c23b-281e-44db-8af0-26d045278b80] Received unexpected event network-vif-plugged-16903aa8-5484-4e72-a5e6-888a35864372 for instance with vm_state deleted and task_state None.
Nov 27 04:48:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:41 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:48:41 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:48:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:48:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:48:42 user nova-compute[75260]: INFO nova.compute.claims [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Claim successful on node user
Nov 27 04:48:43 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:48:43 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:48:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG nova.policy [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05cdf3b00bfe4f728e7fa4e17eba3c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eada319615449deb2152f59ba3d3e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:48:43 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Creating image(s)
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "/opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "/opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.196s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk 1073741824" returned: 0 in 0.051s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Cannot resize image /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Ensure instance console log exists: /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Successfully created port: 9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updating instance_info_cache with network_info: [{"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-12efb820-12ab-442d-a5fe-80b08f12a729" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:44 user nova-compute[75260]: INFO nova.compute.manager [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Terminating instance
Nov 27 04:48:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:48:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Successfully updated port: 9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquired lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-c6b542d0-3dc0-41fb-9cee-151e4de714b2 req-0913cbb4-6d1a-400b-b9ea-ba2dc4d499a3 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Received event network-changed-9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-c6b542d0-3dc0-41fb-9cee-151e4de714b2 req-0913cbb4-6d1a-400b-b9ea-ba2dc4d499a3 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Refreshing instance network info cache due to event network-changed-9298a7c3-676a-4c42-806f-f47c18e8097b. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c6b542d0-3dc0-41fb-9cee-151e4de714b2 req-0913cbb4-6d1a-400b-b9ea-ba2dc4d499a3 service nova] Acquiring lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:48:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Instance destroyed successfully.
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.objects.instance [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'resources' on Instance uuid 12efb820-12ab-442d-a5fe-80b08f12a729 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-658059163',display_name='tempest-AttachVolumeTestJSON-server-658059163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-658059163',id=3,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/GFJ1RKiLPqz1av9ONhStQdrFP19obKkEGU7x+pfBUqsksA5dF6EGjTzeKbXRH4TNzkcH/co8UJKydluZFyoGJur/nedX5G2Wm9SLqgk6epiltTyDcIWj5HSqtnqbSFA==',key_name='tempest-keypair-531623201',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-4gzgeom6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:46:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=12efb820-12ab-442d-a5fe-80b08f12a729,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "e07f49c0-b893-44bf-a195-c351eadfe333", "address": "fa:16:3e:7e:e4:1f", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07f49c0-b8", "ovs_interfaceid": "e07f49c0-b893-44bf-a195-c351eadfe333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG os_vif [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape07f49c0-b8, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3174c905-3b47-4053-b408-8efda2cbed04) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:48:45 user nova-compute[75260]: INFO os_vif [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:e4:1f,bridge_name='br-int',has_traffic_filtering=True,id=e07f49c0-b893-44bf-a195-c351eadfe333,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07f49c0-b8')
Nov 27 04:48:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Deleting instance files /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729_del
Nov 27 04:48:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Deletion of /opt/stack/data/nova/instances/12efb820-12ab-442d-a5fe-80b08f12a729_del complete
Nov 27 04:48:45 user nova-compute[75260]: INFO nova.compute.manager [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Updating instance_info_cache with network_info: [{"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Releasing lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Instance network_info: |[{"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c6b542d0-3dc0-41fb-9cee-151e4de714b2 req-0913cbb4-6d1a-400b-b9ea-ba2dc4d499a3 service nova] Acquired lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.network.neutron [req-c6b542d0-3dc0-41fb-9cee-151e4de714b2 req-0913cbb4-6d1a-400b-b9ea-ba2dc4d499a3 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Refreshing network info cache for port 9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:48:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Start _get_guest_xml network_info=[{"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:48:46 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:48:46 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1048749684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1048749684',id=26,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-0q2dmi1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:48:43Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=1b25e35f-08c6-46e6-8dd4-4a50a2028c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9298a7c3-676a-4c42-806f-f47c18e8097b,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9298a7c3-67') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.objects.instance [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:48:46 user nova-compute[75260]:   <uuid>1b25e35f-08c6-46e6-8dd4-4a50a2028c33</uuid>
Nov 27 04:48:46 user nova-compute[75260]:   <name>instance-0000001a</name>
Nov 27 04:48:46 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:48:46 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:48:46 user nova-compute[75260]:   <metadata>
Nov 27 04:48:46 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:48:46 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:48:46 user nova-compute[75260]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1048749684</nova:name>
Nov 27 04:48:46 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:48:46</nova:creationTime>
Nov 27 04:48:46 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:48:46 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:48:46 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:48:46 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:48:46 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:48:46 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:48:46 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:48:46 user nova-compute[75260]:       <nova:owner>
Nov 27 04:48:46 user nova-compute[75260]:         <nova:user uuid="05cdf3b00bfe4f728e7fa4e17eba3c4e">tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member</nova:user>
Nov 27 04:48:46 user nova-compute[75260]:         <nova:project uuid="7eada319615449deb2152f59ba3d3e6d">tempest-ServerBootFromVolumeStableRescueTest-293744143</nova:project>
Nov 27 04:48:46 user nova-compute[75260]:       </nova:owner>
Nov 27 04:48:46 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:48:46 user nova-compute[75260]:       <nova:ports>
Nov 27 04:48:46 user nova-compute[75260]:         <nova:port uuid="9298a7c3-676a-4c42-806f-f47c18e8097b">
Nov 27 04:48:46 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 04:48:46 user nova-compute[75260]:         </nova:port>
Nov 27 04:48:46 user nova-compute[75260]:       </nova:ports>
Nov 27 04:48:46 user nova-compute[75260]:     </nova:instance>
Nov 27 04:48:46 user nova-compute[75260]:   </metadata>
Nov 27 04:48:46 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:48:46 user nova-compute[75260]:     <system>
Nov 27 04:48:46 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:48:46 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:48:46 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:48:46 user nova-compute[75260]:       <entry name="serial">1b25e35f-08c6-46e6-8dd4-4a50a2028c33</entry>
Nov 27 04:48:46 user nova-compute[75260]:       <entry name="uuid">1b25e35f-08c6-46e6-8dd4-4a50a2028c33</entry>
Nov 27 04:48:46 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:48:46 user nova-compute[75260]:     </system>
Nov 27 04:48:46 user nova-compute[75260]:   </sysinfo>
Nov 27 04:48:46 user nova-compute[75260]:   <os>
Nov 27 04:48:46 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:48:46 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:48:46 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:48:46 user nova-compute[75260]:   </os>
Nov 27 04:48:46 user nova-compute[75260]:   <features>
Nov 27 04:48:46 user nova-compute[75260]:     <acpi/>
Nov 27 04:48:46 user nova-compute[75260]:     <apic/>
Nov 27 04:48:46 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:48:46 user nova-compute[75260]:   </features>
Nov 27 04:48:46 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:48:46 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:48:46 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:48:46 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:48:46 user nova-compute[75260]:   </clock>
Nov 27 04:48:46 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:48:46 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:48:46 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:48:46 user nova-compute[75260]:   </cpu>
Nov 27 04:48:46 user nova-compute[75260]:   <devices>
Nov 27 04:48:46 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:48:46 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:48:46 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk"/>
Nov 27 04:48:46 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:48:46 user nova-compute[75260]:     </disk>
Nov 27 04:48:46 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:48:46 user nova-compute[75260]:       <mac address="fa:16:3e:c2:1f:1a"/>
Nov 27 04:48:46 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:48:46 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:48:46 user nova-compute[75260]:       <target dev="tap9298a7c3-67"/>
Nov 27 04:48:46 user nova-compute[75260]:     </interface>
Nov 27 04:48:46 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:48:46 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/console.log" append="off"/>
Nov 27 04:48:46 user nova-compute[75260]:     </serial>
Nov 27 04:48:46 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:48:46 user nova-compute[75260]:     <video>
Nov 27 04:48:46 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:48:46 user nova-compute[75260]:     </video>
Nov 27 04:48:46 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:48:46 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:48:46 user nova-compute[75260]:     </rng>
Nov 27 04:48:46 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:48:46 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:48:46 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:48:46 user nova-compute[75260]:     </memballoon>
Nov 27 04:48:46 user nova-compute[75260]:   </devices>
Nov 27 04:48:46 user nova-compute[75260]: </domain>
Nov 27 04:48:46 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1048749684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1048749684',id=26,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-0q2dmi1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:48:43Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=1b25e35f-08c6-46e6-8dd4-4a50a2028c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9298a7c3-676a-4c42-806f-f47c18e8097b,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9298a7c3-67') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG os_vif [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9298a7c3-676a-4c42-806f-f47c18e8097b,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9298a7c3-67') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3faeda90-eea3-5acb-a48b-3c2f4e12da06', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9298a7c3-67, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9298a7c3-67, col_values=(('qos', UUID('58c0a7cb-f12f-4c07-b53d-f851c1d75d30')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9298a7c3-67, col_values=(('external_ids', {'iface-id': '9298a7c3-676a-4c42-806f-f47c18e8097b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:1f:1a', 'vm-uuid': '1b25e35f-08c6-46e6-8dd4-4a50a2028c33'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:46 user nova-compute[75260]: INFO os_vif [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9298a7c3-676a-4c42-806f-f47c18e8097b,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9298a7c3-67')
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No VIF found with MAC fa:16:3e:c2:1f:1a, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.network.neutron [req-c6b542d0-3dc0-41fb-9cee-151e4de714b2 req-0913cbb4-6d1a-400b-b9ea-ba2dc4d499a3 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Updated VIF entry in instance network info cache for port 9298a7c3-676a-4c42-806f-f47c18e8097b. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.network.neutron [req-c6b542d0-3dc0-41fb-9cee-151e4de714b2 req-0913cbb4-6d1a-400b-b9ea-ba2dc4d499a3 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Updating instance_info_cache with network_info: [{"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c6b542d0-3dc0-41fb-9cee-151e4de714b2 req-0913cbb4-6d1a-400b-b9ea-ba2dc4d499a3 service nova] Releasing lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-b5b955be-efe3-449a-b244-ba3d29d7f98b req-05163ac1-272a-43d3-9cea-e82d6f185ac3 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Received event network-vif-deleted-e07f49c0-b893-44bf-a195-c351eadfe333 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:48:46 user nova-compute[75260]: INFO nova.compute.manager [req-b5b955be-efe3-449a-b244-ba3d29d7f98b req-05163ac1-272a-43d3-9cea-e82d6f185ac3 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Neutron deleted interface e07f49c0-b893-44bf-a195-c351eadfe333; detaching it from the instance and deleting it from the info cache
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.network.neutron [req-b5b955be-efe3-449a-b244-ba3d29d7f98b req-05163ac1-272a-43d3-9cea-e82d6f185ac3 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:48:46 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Took 1.17 seconds to deallocate network for instance.
Nov 27 04:48:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-b5b955be-efe3-449a-b244-ba3d29d7f98b req-05163ac1-272a-43d3-9cea-e82d6f185ac3 service nova] [instance: 12efb820-12ab-442d-a5fe-80b08f12a729] Detach interface failed, port_id=e07f49c0-b893-44bf-a195-c351eadfe333, reason: Instance 12efb820-12ab-442d-a5fe-80b08f12a729 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:47 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Deleted allocations for instance 12efb820-12ab-442d-a5fe-80b08f12a729
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21861fa3-fd06-47ee-99a0-ea482a769bd4 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "12efb820-12ab-442d-a5fe-80b08f12a729" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.697s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:48:50 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:48:50 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8150MB free_disk=25.518726348876953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Instance spawned successfully.
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:48:50 user nova-compute[75260]: INFO nova.compute.manager [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d0364679-4db1-4da8-bce8-80eea41feb13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:48:50 user nova-compute[75260]: INFO nova.compute.manager [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Took 7.49 seconds to build instance.
Nov 27 04:48:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7a781b71-10e3-46d5-b42e-53cff258f7c6 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.597s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:51 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:48:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:48:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-faef9a93-13dc-42fa-8e51-9f4faf94f3e3 req-1ada409c-9726-4aca-847e-fa8ca351c10c service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Received event network-vif-plugged-9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:48:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-faef9a93-13dc-42fa-8e51-9f4faf94f3e3 req-1ada409c-9726-4aca-847e-fa8ca351c10c service nova] Acquiring lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-faef9a93-13dc-42fa-8e51-9f4faf94f3e3 req-1ada409c-9726-4aca-847e-fa8ca351c10c service nova] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-faef9a93-13dc-42fa-8e51-9f4faf94f3e3 req-1ada409c-9726-4aca-847e-fa8ca351c10c service nova] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-faef9a93-13dc-42fa-8e51-9f4faf94f3e3 req-1ada409c-9726-4aca-847e-fa8ca351c10c service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] No waiting events found dispatching network-vif-plugged-9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:48:52 user nova-compute[75260]: WARNING nova.compute.manager [req-faef9a93-13dc-42fa-8e51-9f4faf94f3e3 req-1ada409c-9726-4aca-847e-fa8ca351c10c service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Received unexpected event network-vif-plugged-9298a7c3-676a-4c42-806f-f47c18e8097b for instance with vm_state active and task_state None.
Nov 27 04:48:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-77218f25-c842-4e88-a98b-0024d117f5c7 req-5dc06084-9f51-4629-b475-068e5695d461 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Received event network-vif-plugged-9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:48:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-77218f25-c842-4e88-a98b-0024d117f5c7 req-5dc06084-9f51-4629-b475-068e5695d461 service nova] Acquiring lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-77218f25-c842-4e88-a98b-0024d117f5c7 req-5dc06084-9f51-4629-b475-068e5695d461 service nova] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-77218f25-c842-4e88-a98b-0024d117f5c7 req-5dc06084-9f51-4629-b475-068e5695d461 service nova] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-77218f25-c842-4e88-a98b-0024d117f5c7 req-5dc06084-9f51-4629-b475-068e5695d461 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] No waiting events found dispatching network-vif-plugged-9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:48:54 user nova-compute[75260]: WARNING nova.compute.manager [req-77218f25-c842-4e88-a98b-0024d117f5c7 req-5dc06084-9f51-4629-b475-068e5695d461 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Received unexpected event network-vif-plugged-9298a7c3-676a-4c42-806f-f47c18e8097b for instance with vm_state active and task_state None.
Nov 27 04:48:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:48:57 user nova-compute[75260]: INFO nova.compute.claims [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Claim successful on node user
Nov 27 04:48:57 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:48:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:48:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG nova.policy [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82e2cb36c4904d189ad7b29f933f480e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c37c5e030f48b293656f786ea1aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:48:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Creating image(s)
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "/opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "/opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "/opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.196s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk 1073741824" returned: 0 in 0.062s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Successfully created port: d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Cannot resize image /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Ensure instance console log exists: /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:48:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Successfully updated port: d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquired lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-5a9fecfc-0c6e-4006-bc2a-2e33982de501 req-1321210a-43e3-467e-9e75-2952db2e5212 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received event network-changed-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-5a9fecfc-0c6e-4006-bc2a-2e33982de501 req-1321210a-43e3-467e-9e75-2952db2e5212 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Refreshing instance network info cache due to event network-changed-d051edcd-601a-4c12-b8b0-7f1081837279. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5a9fecfc-0c6e-4006-bc2a-2e33982de501 req-1321210a-43e3-467e-9e75-2952db2e5212 service nova] Acquiring lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Updating instance_info_cache with network_info: [{"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Releasing lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Instance network_info: |[{"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5a9fecfc-0c6e-4006-bc2a-2e33982de501 req-1321210a-43e3-467e-9e75-2952db2e5212 service nova] Acquired lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-5a9fecfc-0c6e-4006-bc2a-2e33982de501 req-1321210a-43e3-467e-9e75-2952db2e5212 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Refreshing network info cache for port d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Start _get_guest_xml network_info=[{"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:48:59 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:48:59 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1619704992',display_name='tempest-TestStampPattern-server-1619704992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1619704992',id=27,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEm4ycTHTc6irbNWzi82l/iS13TDWE7Tbj1uK6oYdFuMWX34xe8U7Ts31a/zWSA7B9JpTfl9arNxPKlrPcez9SIQg8qSky+ZGAnVKHoKPTF0lkUsqytbC2eApCQB/fW4Dw==',key_name='tempest-TestStampPattern-81536007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06c37c5e030f48b293656f786ea1aeef',ramdisk_id='',reservation_id='r-hjzmv68y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-785030743',owner_user_name='tempest-TestStampPattern-785030743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:48:58Z,user_data=None,user_id='82e2cb36c4904d189ad7b29f933f480e',uuid=60da14c7-b49d-454d-ba99-ec308c4ceb96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converting VIF {"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:83:c0,bridge_name='br-int',has_traffic_filtering=True,id=d051edcd-601a-4c12-b8b0-7f1081837279,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd051edcd-60') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lazy-loading 'pci_devices' on Instance uuid 60da14c7-b49d-454d-ba99-ec308c4ceb96 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:48:59 user nova-compute[75260]:   <uuid>60da14c7-b49d-454d-ba99-ec308c4ceb96</uuid>
Nov 27 04:48:59 user nova-compute[75260]:   <name>instance-0000001b</name>
Nov 27 04:48:59 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:48:59 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:48:59 user nova-compute[75260]:   <metadata>
Nov 27 04:48:59 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:48:59 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:48:59 user nova-compute[75260]:       <nova:name>tempest-TestStampPattern-server-1619704992</nova:name>
Nov 27 04:48:59 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:48:59</nova:creationTime>
Nov 27 04:48:59 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:48:59 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:48:59 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:48:59 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:48:59 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:48:59 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:48:59 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:48:59 user nova-compute[75260]:       <nova:owner>
Nov 27 04:48:59 user nova-compute[75260]:         <nova:user uuid="82e2cb36c4904d189ad7b29f933f480e">tempest-TestStampPattern-785030743-project-member</nova:user>
Nov 27 04:48:59 user nova-compute[75260]:         <nova:project uuid="06c37c5e030f48b293656f786ea1aeef">tempest-TestStampPattern-785030743</nova:project>
Nov 27 04:48:59 user nova-compute[75260]:       </nova:owner>
Nov 27 04:48:59 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:48:59 user nova-compute[75260]:       <nova:ports>
Nov 27 04:48:59 user nova-compute[75260]:         <nova:port uuid="d051edcd-601a-4c12-b8b0-7f1081837279">
Nov 27 04:48:59 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 04:48:59 user nova-compute[75260]:         </nova:port>
Nov 27 04:48:59 user nova-compute[75260]:       </nova:ports>
Nov 27 04:48:59 user nova-compute[75260]:     </nova:instance>
Nov 27 04:48:59 user nova-compute[75260]:   </metadata>
Nov 27 04:48:59 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:48:59 user nova-compute[75260]:     <system>
Nov 27 04:48:59 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:48:59 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:48:59 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:48:59 user nova-compute[75260]:       <entry name="serial">60da14c7-b49d-454d-ba99-ec308c4ceb96</entry>
Nov 27 04:48:59 user nova-compute[75260]:       <entry name="uuid">60da14c7-b49d-454d-ba99-ec308c4ceb96</entry>
Nov 27 04:48:59 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:48:59 user nova-compute[75260]:     </system>
Nov 27 04:48:59 user nova-compute[75260]:   </sysinfo>
Nov 27 04:48:59 user nova-compute[75260]:   <os>
Nov 27 04:48:59 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:48:59 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:48:59 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:48:59 user nova-compute[75260]:   </os>
Nov 27 04:48:59 user nova-compute[75260]:   <features>
Nov 27 04:48:59 user nova-compute[75260]:     <acpi/>
Nov 27 04:48:59 user nova-compute[75260]:     <apic/>
Nov 27 04:48:59 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:48:59 user nova-compute[75260]:   </features>
Nov 27 04:48:59 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:48:59 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:48:59 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:48:59 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:48:59 user nova-compute[75260]:   </clock>
Nov 27 04:48:59 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:48:59 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:48:59 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:48:59 user nova-compute[75260]:   </cpu>
Nov 27 04:48:59 user nova-compute[75260]:   <devices>
Nov 27 04:48:59 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:48:59 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:48:59 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk"/>
Nov 27 04:48:59 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:48:59 user nova-compute[75260]:     </disk>
Nov 27 04:48:59 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:48:59 user nova-compute[75260]:       <mac address="fa:16:3e:53:83:c0"/>
Nov 27 04:48:59 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:48:59 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:48:59 user nova-compute[75260]:       <target dev="tapd051edcd-60"/>
Nov 27 04:48:59 user nova-compute[75260]:     </interface>
Nov 27 04:48:59 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:48:59 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/console.log" append="off"/>
Nov 27 04:48:59 user nova-compute[75260]:     </serial>
Nov 27 04:48:59 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:48:59 user nova-compute[75260]:     <video>
Nov 27 04:48:59 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:48:59 user nova-compute[75260]:     </video>
Nov 27 04:48:59 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:48:59 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:48:59 user nova-compute[75260]:     </rng>
Nov 27 04:48:59 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:48:59 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:48:59 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:48:59 user nova-compute[75260]:     </memballoon>
Nov 27 04:48:59 user nova-compute[75260]:   </devices>
Nov 27 04:48:59 user nova-compute[75260]: </domain>
Nov 27 04:48:59 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1619704992',display_name='tempest-TestStampPattern-server-1619704992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1619704992',id=27,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEm4ycTHTc6irbNWzi82l/iS13TDWE7Tbj1uK6oYdFuMWX34xe8U7Ts31a/zWSA7B9JpTfl9arNxPKlrPcez9SIQg8qSky+ZGAnVKHoKPTF0lkUsqytbC2eApCQB/fW4Dw==',key_name='tempest-TestStampPattern-81536007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06c37c5e030f48b293656f786ea1aeef',ramdisk_id='',reservation_id='r-hjzmv68y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-785030743',owner_user_name='tempest-TestStampPattern-785030743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:48:58Z,user_data=None,user_id='82e2cb36c4904d189ad7b29f933f480e',uuid=60da14c7-b49d-454d-ba99-ec308c4ceb96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converting VIF {"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:83:c0,bridge_name='br-int',has_traffic_filtering=True,id=d051edcd-601a-4c12-b8b0-7f1081837279,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd051edcd-60') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG os_vif [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:83:c0,bridge_name='br-int',has_traffic_filtering=True,id=d051edcd-601a-4c12-b8b0-7f1081837279,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd051edcd-60') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '898e1849-029d-5f8b-ad60-9588223d7984', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd051edcd-60, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd051edcd-60, col_values=(('qos', UUID('50016549-a856-43d7-a3fc-a5e4a60a6e4f')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd051edcd-60, col_values=(('external_ids', {'iface-id': 'd051edcd-601a-4c12-b8b0-7f1081837279', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:83:c0', 'vm-uuid': '60da14c7-b49d-454d-ba99-ec308c4ceb96'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:48:59 user nova-compute[75260]: INFO os_vif [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:83:c0,bridge_name='br-int',has_traffic_filtering=True,id=d051edcd-601a-4c12-b8b0-7f1081837279,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd051edcd-60')
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:48:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] No VIF found with MAC fa:16:3e:53:83:c0, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:49:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-5a9fecfc-0c6e-4006-bc2a-2e33982de501 req-1321210a-43e3-467e-9e75-2952db2e5212 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Updated VIF entry in instance network info cache for port d051edcd-601a-4c12-b8b0-7f1081837279. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:49:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-5a9fecfc-0c6e-4006-bc2a-2e33982de501 req-1321210a-43e3-467e-9e75-2952db2e5212 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Updating instance_info_cache with network_info: [{"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:49:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5a9fecfc-0c6e-4006-bc2a-2e33982de501 req-1321210a-43e3-467e-9e75-2952db2e5212 service nova] Releasing lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:49:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:01 user nova-compute[75260]: DEBUG nova.compute.manager [req-1c34de3f-e389-4d89-80b4-decccc8be104 req-2d4bedc8-57ee-45c6-9a62-752c58bb563e service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received event network-vif-plugged-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1c34de3f-e389-4d89-80b4-decccc8be104 req-2d4bedc8-57ee-45c6-9a62-752c58bb563e service nova] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1c34de3f-e389-4d89-80b4-decccc8be104 req-2d4bedc8-57ee-45c6-9a62-752c58bb563e service nova] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1c34de3f-e389-4d89-80b4-decccc8be104 req-2d4bedc8-57ee-45c6-9a62-752c58bb563e service nova] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:01 user nova-compute[75260]: DEBUG nova.compute.manager [req-1c34de3f-e389-4d89-80b4-decccc8be104 req-2d4bedc8-57ee-45c6-9a62-752c58bb563e service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] No waiting events found dispatching network-vif-plugged-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:01 user nova-compute[75260]: WARNING nova.compute.manager [req-1c34de3f-e389-4d89-80b4-decccc8be104 req-2d4bedc8-57ee-45c6-9a62-752c58bb563e service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received unexpected event network-vif-plugged-d051edcd-601a-4c12-b8b0-7f1081837279 for instance with vm_state building and task_state spawning.
Nov 27 04:49:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:49:03 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Instance spawned successfully.
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f086499-3ca6-474c-9b0b-346013b0f8d6 req-314d7eb1-1582-459c-98df-687e4fc0697a service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received event network-vif-plugged-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f086499-3ca6-474c-9b0b-346013b0f8d6 req-314d7eb1-1582-459c-98df-687e4fc0697a service nova] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f086499-3ca6-474c-9b0b-346013b0f8d6 req-314d7eb1-1582-459c-98df-687e4fc0697a service nova] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f086499-3ca6-474c-9b0b-346013b0f8d6 req-314d7eb1-1582-459c-98df-687e4fc0697a service nova] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f086499-3ca6-474c-9b0b-346013b0f8d6 req-314d7eb1-1582-459c-98df-687e4fc0697a service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] No waiting events found dispatching network-vif-plugged-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:03 user nova-compute[75260]: WARNING nova.compute.manager [req-2f086499-3ca6-474c-9b0b-346013b0f8d6 req-314d7eb1-1582-459c-98df-687e4fc0697a service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received unexpected event network-vif-plugged-d051edcd-601a-4c12-b8b0-7f1081837279 for instance with vm_state building and task_state spawning.
Nov 27 04:49:03 user nova-compute[75260]: INFO nova.compute.manager [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 27 04:49:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:49:03 user nova-compute[75260]: INFO nova.compute.manager [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Took 6.42 seconds to build instance.
Nov 27 04:49:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5ee2726-461c-4b7d-a087-31d16ff062c3 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.529s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG nova.compute.manager [req-888a505d-7cab-43f7-98da-89e519e4d5ab req-fc06b6a4-89a4-4292-8bea-2bdc4c813750 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-changed-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG nova.compute.manager [req-888a505d-7cab-43f7-98da-89e519e4d5ab req-fc06b6a4-89a4-4292-8bea-2bdc4c813750 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Refreshing instance network info cache due to event network-changed-e8622473-aed7-41ef-923e-b8565a6783c2. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-888a505d-7cab-43f7-98da-89e519e4d5ab req-fc06b6a4-89a4-4292-8bea-2bdc4c813750 service nova] Acquiring lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-888a505d-7cab-43f7-98da-89e519e4d5ab req-fc06b6a4-89a4-4292-8bea-2bdc4c813750 service nova] Acquired lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG nova.network.neutron [req-888a505d-7cab-43f7-98da-89e519e4d5ab req-fc06b6a4-89a4-4292-8bea-2bdc4c813750 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Refreshing network info cache for port e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG nova.objects.instance [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'flavor' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:06 user nova-compute[75260]: INFO nova.compute.manager [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Attaching volume 1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 to /dev/vdb
Nov 27 04:49:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG os_brick.utils [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4af9a5-02e4-4b5f-b040-2f34d60aa604]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdfb1fd-f288-4cd1-b539-18d9597e8d74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1c58a3-99b9-42c8-b57e-5d8ef0d80324]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc599c6b-fda1-4d2c-989a-e99a81b0e870]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:49:06 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:49:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7743b3-8659-495f-b29e-8113062b6040]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG os_brick.utils [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:49:06 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updating existing volume attachment record: fd2b2fb5-0952-4f74-9e01-52a232d1f9ed {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:49:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-888a505d-7cab-43f7-98da-89e519e4d5ab req-fc06b6a4-89a4-4292-8bea-2bdc4c813750 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updated VIF entry in instance network info cache for port e8622473-aed7-41ef-923e-b8565a6783c2. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:49:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-888a505d-7cab-43f7-98da-89e519e4d5ab req-fc06b6a4-89a4-4292-8bea-2bdc4c813750 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updating instance_info_cache with network_info: [{"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:49:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-888a505d-7cab-43f7-98da-89e519e4d5ab req-fc06b6a4-89a4-4292-8bea-2bdc4c813750 service nova] Releasing lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:49:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rMGhcbiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:49:13 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:49:13 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:49:13 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[482cd1c4-78b1-481a-9603-a4d367289cfc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:49:13 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1748c1-b4ad-47b1-9071-af7a3e0ced81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9] added
Nov 27 04:49:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[048e4ebc-7e85-4bad-a3f9-c8ab34066c12]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[309590f3-5b01-46d9-86a4-3cd87a26b217]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rMGhcbiJ {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rMGhcbiJ" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf104af2-5a8f-40b7-b31a-1a3f26b75d43]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rMGhcbiJ'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f20d2e-45fa-4d46-8c53-41a6906ea64d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[708aee68-8fb6-4c7b-b97c-9e92122cf895]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 04:49:13 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 04:49:13 user nova-compute[75260]:  {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:49:13 user nova-compute[75260]: WARNING os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 04:49:13 user nova-compute[75260]: 
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb8ab95-00af-4fd3-b812-44f3c2650762]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9, portal: 172.16.0.220,3260]
Nov 27 04:49:13 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9, portal: 172.16.0.220,3260] successful.
Nov 27 04:49:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[41177749-b4a2-40c8-a9f6-646f7a69b4a6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[258cbb66-a864-41a8-81ba-37f1d3b3bfc3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:49:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:49:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c3e7be-9bc1-413d-81b4-b23cd2f8e405]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:49:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rMGhcbiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:49:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:49:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23431656464613161', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:49:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431656464613161', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:49:14 user nova-compute[75260]: DEBUG nova.objects.instance [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'flavor' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:49:14 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:49:14 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:49:14 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:49:14 user nova-compute[75260]:   <serial>1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9</serial>
Nov 27 04:49:14 user nova-compute[75260]: </disk>
Nov 27 04:49:14 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:49:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No VIF found with MAC fa:16:3e:06:b3:7b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:49:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-53b4e9c7-2e73-42d5-b6d7-3283435f10cb tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.757s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:16 user nova-compute[75260]: INFO nova.compute.manager [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Rescuing
Nov 27 04:49:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:49:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquired lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:49:16 user nova-compute[75260]: DEBUG nova.network.neutron [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:49:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:17 user nova-compute[75260]: DEBUG nova.network.neutron [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updating instance_info_cache with network_info: [{"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:49:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Releasing lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:49:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-c0d849f7-b6d6-41e5-8daf-349666063c1a req-2dd70c5b-31fe-490c-9285-ff9d882dc7e2 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-unplugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c0d849f7-b6d6-41e5-8daf-349666063c1a req-2dd70c5b-31fe-490c-9285-ff9d882dc7e2 service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c0d849f7-b6d6-41e5-8daf-349666063c1a req-2dd70c5b-31fe-490c-9285-ff9d882dc7e2 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c0d849f7-b6d6-41e5-8daf-349666063c1a req-2dd70c5b-31fe-490c-9285-ff9d882dc7e2 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-c0d849f7-b6d6-41e5-8daf-349666063c1a req-2dd70c5b-31fe-490c-9285-ff9d882dc7e2 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-unplugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:17 user nova-compute[75260]: WARNING nova.compute.manager [req-c0d849f7-b6d6-41e5-8daf-349666063c1a req-2dd70c5b-31fe-490c-9285-ff9d882dc7e2 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-unplugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state active and task_state rescuing.
Nov 27 04:49:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:18 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Instance destroyed successfully.
Nov 27 04:49:18 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Attempting rescue
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75260) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Instance directory exists: not creating {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 04:49:18 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Creating image(s)
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'trusted_certs' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.212s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue" returned: 0 in 0.058s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'migration_context' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.base [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<98005938-a919-41cd-94bb-bfc1c9f7ea04> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Start _get_guest_xml network_info=[{"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "vif_mac": "fa:16:3e:06:b3:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'resources' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.base [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<98005938-a919-41cd-94bb-bfc1c9f7ea04> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'numa_topology' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.base [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<98005938-a919-41cd-94bb-bfc1c9f7ea04> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:49:18 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:49:18 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'vcpu_model' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.base [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<98005938-a919-41cd-94bb-bfc1c9f7ea04> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1800352952',display_name='tempest-ServerRescueNegativeTestJSON-server-1800352952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1800352952',id=25,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8+BTyfT3yhS/SbL6jWb2kqJSpemmWm+PhfuKA4OHRNL+O4piNSG2X5iPQjpz6riZ0IGRQbpghMSwbrA7MzmD26qCd+NSHWkwJtq4585JE9pls2BftHOx/1bQv4gHdvlg==',key_name='tempest-keypair-404684156',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:47:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-gqbk6o4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=98005938-a919-41cd-94bb-bfc1c9f7ea04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "vif_mac": "fa:16:3e:06:b3:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "vif_mac": "fa:16:3e:06:b3:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:b3:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8622473-aed7-41ef-923e-b8565a6783c2,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8622473-ae') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'pci_devices' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.objects.base [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Object Instance<98005938-a919-41cd-94bb-bfc1c9f7ea04> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:49:18 user nova-compute[75260]:   <uuid>98005938-a919-41cd-94bb-bfc1c9f7ea04</uuid>
Nov 27 04:49:18 user nova-compute[75260]:   <name>instance-00000019</name>
Nov 27 04:49:18 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:49:18 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:49:18 user nova-compute[75260]:   <metadata>
Nov 27 04:49:18 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:49:18 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:49:18 user nova-compute[75260]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1800352952</nova:name>
Nov 27 04:49:18 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:49:18</nova:creationTime>
Nov 27 04:49:18 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:49:18 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:49:18 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:49:18 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:49:18 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:49:18 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:49:18 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:49:18 user nova-compute[75260]:       <nova:owner>
Nov 27 04:49:18 user nova-compute[75260]:         <nova:user uuid="41069f4d1d404da19dcfb2a3552fcddb">tempest-ServerRescueNegativeTestJSON-1319145768-project-member</nova:user>
Nov 27 04:49:18 user nova-compute[75260]:         <nova:project uuid="0e5f7694b2294e16aec0248f1217b148">tempest-ServerRescueNegativeTestJSON-1319145768</nova:project>
Nov 27 04:49:18 user nova-compute[75260]:       </nova:owner>
Nov 27 04:49:18 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:49:18 user nova-compute[75260]:       <nova:ports>
Nov 27 04:49:18 user nova-compute[75260]:         <nova:port uuid="e8622473-aed7-41ef-923e-b8565a6783c2">
Nov 27 04:49:18 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 04:49:18 user nova-compute[75260]:         </nova:port>
Nov 27 04:49:18 user nova-compute[75260]:       </nova:ports>
Nov 27 04:49:18 user nova-compute[75260]:     </nova:instance>
Nov 27 04:49:18 user nova-compute[75260]:   </metadata>
Nov 27 04:49:18 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:49:18 user nova-compute[75260]:     <system>
Nov 27 04:49:18 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:49:18 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:49:18 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:49:18 user nova-compute[75260]:       <entry name="serial">98005938-a919-41cd-94bb-bfc1c9f7ea04</entry>
Nov 27 04:49:18 user nova-compute[75260]:       <entry name="uuid">98005938-a919-41cd-94bb-bfc1c9f7ea04</entry>
Nov 27 04:49:18 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:49:18 user nova-compute[75260]:     </system>
Nov 27 04:49:18 user nova-compute[75260]:   </sysinfo>
Nov 27 04:49:18 user nova-compute[75260]:   <os>
Nov 27 04:49:18 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:49:18 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:49:18 user nova-compute[75260]:   </os>
Nov 27 04:49:18 user nova-compute[75260]:   <features>
Nov 27 04:49:18 user nova-compute[75260]:     <acpi/>
Nov 27 04:49:18 user nova-compute[75260]:     <apic/>
Nov 27 04:49:18 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:49:18 user nova-compute[75260]:   </features>
Nov 27 04:49:18 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:49:18 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:49:18 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:49:18 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:49:18 user nova-compute[75260]:   </clock>
Nov 27 04:49:18 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:49:18 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:49:18 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:49:18 user nova-compute[75260]:   </cpu>
Nov 27 04:49:18 user nova-compute[75260]:   <devices>
Nov 27 04:49:18 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:49:18 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:49:18 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue"/>
Nov 27 04:49:18 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:49:18 user nova-compute[75260]:     </disk>
Nov 27 04:49:18 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:49:18 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:49:18 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk"/>
Nov 27 04:49:18 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:49:18 user nova-compute[75260]:     </disk>
Nov 27 04:49:18 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:49:18 user nova-compute[75260]:       <mac address="fa:16:3e:06:b3:7b"/>
Nov 27 04:49:18 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:49:18 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:49:18 user nova-compute[75260]:       <target dev="tape8622473-ae"/>
Nov 27 04:49:18 user nova-compute[75260]:     </interface>
Nov 27 04:49:18 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:49:18 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/console.log" append="off"/>
Nov 27 04:49:18 user nova-compute[75260]:     </serial>
Nov 27 04:49:18 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:49:18 user nova-compute[75260]:     <video>
Nov 27 04:49:18 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:49:18 user nova-compute[75260]:     </video>
Nov 27 04:49:18 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:49:18 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:49:18 user nova-compute[75260]:     </rng>
Nov 27 04:49:18 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:49:18 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:49:18 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:49:18 user nova-compute[75260]:     </memballoon>
Nov 27 04:49:18 user nova-compute[75260]:   </devices>
Nov 27 04:49:18 user nova-compute[75260]: </domain>
Nov 27 04:49:18 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:49:18 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Instance destroyed successfully.
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] No VIF found with MAC fa:16:3e:06:b3:7b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "3079fe74-317c-4325-9667-45a6754af567" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:49:19 user nova-compute[75260]: INFO nova.compute.claims [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Claim successful on node user
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.network.neutron [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:49:19 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.policy [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1b9f31e8cfe433ba6988d8be95ff00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a01c78567be4d4ca62fd53ad2937ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-d60e4bb6-aa4f-47bd-b031-bf1f4466c838 req-4b9282e5-f5ba-4459-8dbd-cda20822e02c service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d60e4bb6-aa4f-47bd-b031-bf1f4466c838 req-4b9282e5-f5ba-4459-8dbd-cda20822e02c service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d60e4bb6-aa4f-47bd-b031-bf1f4466c838 req-4b9282e5-f5ba-4459-8dbd-cda20822e02c service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d60e4bb6-aa4f-47bd-b031-bf1f4466c838 req-4b9282e5-f5ba-4459-8dbd-cda20822e02c service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-d60e4bb6-aa4f-47bd-b031-bf1f4466c838 req-4b9282e5-f5ba-4459-8dbd-cda20822e02c service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:19 user nova-compute[75260]: WARNING nova.compute.manager [req-d60e4bb6-aa4f-47bd-b031-bf1f4466c838 req-4b9282e5-f5ba-4459-8dbd-cda20822e02c service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state active and task_state rescuing.
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:49:19 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Creating image(s)
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "/opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "/opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "/opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.165s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk 1073741824" returned: 0 in 0.068s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Successfully created port: a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Cannot resize image /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Ensure instance console log exists: /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Successfully updated port: a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "refresh_cache-3079fe74-317c-4325-9667-45a6754af567" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquired lock "refresh_cache-3079fe74-317c-4325-9667-45a6754af567" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-a976e8b8-0cef-45da-bc92-12f5c4b59bca req-a9219e8d-36ec-4dd2-ab40-c8d9196dcea1 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received event network-changed-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-a976e8b8-0cef-45da-bc92-12f5c4b59bca req-a9219e8d-36ec-4dd2-ab40-c8d9196dcea1 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Refreshing instance network info cache due to event network-changed-a99a93fb-2492-43cd-be0b-04fbcf66e165. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a976e8b8-0cef-45da-bc92-12f5c4b59bca req-a9219e8d-36ec-4dd2-ab40-c8d9196dcea1 service nova] Acquiring lock "refresh_cache-3079fe74-317c-4325-9667-45a6754af567" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:49:20 user nova-compute[75260]: DEBUG nova.network.neutron [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.network.neutron [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Updating instance_info_cache with network_info: [{"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Releasing lock "refresh_cache-3079fe74-317c-4325-9667-45a6754af567" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.compute.manager [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Instance network_info: |[{"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a976e8b8-0cef-45da-bc92-12f5c4b59bca req-a9219e8d-36ec-4dd2-ab40-c8d9196dcea1 service nova] Acquired lock "refresh_cache-3079fe74-317c-4325-9667-45a6754af567" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.network.neutron [req-a976e8b8-0cef-45da-bc92-12f5c4b59bca req-a9219e8d-36ec-4dd2-ab40-c8d9196dcea1 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Refreshing network info cache for port a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Start _get_guest_xml network_info=[{"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:49:21 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:49:21 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2031966221',display_name='tempest-AttachVolumeNegativeTest-server-2031966221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2031966221',id=28,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoJaNZ0zgjmRild6Z5cxzEnhy9R4Sm8sV/rbA0Snj7iJ4yAvU8HjLMKMaGD9hT5SxCvcAVug43+mBo6zjpyX/ig1MQlzJGW5kIHzIZvaY0rNM5XZb8ZbTHYu0MFOTewfQ==',key_name='tempest-keypair-1106994504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-jmuzvatq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=3079fe74-317c-4325-9667-45a6754af567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:56:60,bridge_name='br-int',has_traffic_filtering=True,id=a99a93fb-2492-43cd-be0b-04fbcf66e165,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99a93fb-24') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.objects.instance [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'pci_devices' on Instance uuid 3079fe74-317c-4325-9667-45a6754af567 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:49:21 user nova-compute[75260]:   <uuid>3079fe74-317c-4325-9667-45a6754af567</uuid>
Nov 27 04:49:21 user nova-compute[75260]:   <name>instance-0000001c</name>
Nov 27 04:49:21 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:49:21 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:49:21 user nova-compute[75260]:   <metadata>
Nov 27 04:49:21 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:49:21 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:49:21 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2031966221</nova:name>
Nov 27 04:49:21 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:49:21</nova:creationTime>
Nov 27 04:49:21 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:49:21 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:49:21 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:49:21 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:49:21 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:49:21 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:49:21 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:49:21 user nova-compute[75260]:       <nova:owner>
Nov 27 04:49:21 user nova-compute[75260]:         <nova:user uuid="a1b9f31e8cfe433ba6988d8be95ff00c">tempest-AttachVolumeNegativeTest-1561165574-project-member</nova:user>
Nov 27 04:49:21 user nova-compute[75260]:         <nova:project uuid="1a01c78567be4d4ca62fd53ad2937ff5">tempest-AttachVolumeNegativeTest-1561165574</nova:project>
Nov 27 04:49:21 user nova-compute[75260]:       </nova:owner>
Nov 27 04:49:21 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:49:21 user nova-compute[75260]:       <nova:ports>
Nov 27 04:49:21 user nova-compute[75260]:         <nova:port uuid="a99a93fb-2492-43cd-be0b-04fbcf66e165">
Nov 27 04:49:21 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 04:49:21 user nova-compute[75260]:         </nova:port>
Nov 27 04:49:21 user nova-compute[75260]:       </nova:ports>
Nov 27 04:49:21 user nova-compute[75260]:     </nova:instance>
Nov 27 04:49:21 user nova-compute[75260]:   </metadata>
Nov 27 04:49:21 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:49:21 user nova-compute[75260]:     <system>
Nov 27 04:49:21 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:49:21 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:49:21 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:49:21 user nova-compute[75260]:       <entry name="serial">3079fe74-317c-4325-9667-45a6754af567</entry>
Nov 27 04:49:21 user nova-compute[75260]:       <entry name="uuid">3079fe74-317c-4325-9667-45a6754af567</entry>
Nov 27 04:49:21 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:49:21 user nova-compute[75260]:     </system>
Nov 27 04:49:21 user nova-compute[75260]:   </sysinfo>
Nov 27 04:49:21 user nova-compute[75260]:   <os>
Nov 27 04:49:21 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:49:21 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:49:21 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:49:21 user nova-compute[75260]:   </os>
Nov 27 04:49:21 user nova-compute[75260]:   <features>
Nov 27 04:49:21 user nova-compute[75260]:     <acpi/>
Nov 27 04:49:21 user nova-compute[75260]:     <apic/>
Nov 27 04:49:21 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:49:21 user nova-compute[75260]:   </features>
Nov 27 04:49:21 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:49:21 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:49:21 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:49:21 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:49:21 user nova-compute[75260]:   </clock>
Nov 27 04:49:21 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:49:21 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:49:21 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:49:21 user nova-compute[75260]:   </cpu>
Nov 27 04:49:21 user nova-compute[75260]:   <devices>
Nov 27 04:49:21 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:49:21 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:49:21 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk"/>
Nov 27 04:49:21 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:49:21 user nova-compute[75260]:     </disk>
Nov 27 04:49:21 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:49:21 user nova-compute[75260]:       <mac address="fa:16:3e:98:56:60"/>
Nov 27 04:49:21 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:49:21 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:49:21 user nova-compute[75260]:       <target dev="tapa99a93fb-24"/>
Nov 27 04:49:21 user nova-compute[75260]:     </interface>
Nov 27 04:49:21 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:49:21 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/console.log" append="off"/>
Nov 27 04:49:21 user nova-compute[75260]:     </serial>
Nov 27 04:49:21 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:49:21 user nova-compute[75260]:     <video>
Nov 27 04:49:21 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:49:21 user nova-compute[75260]:     </video>
Nov 27 04:49:21 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:49:21 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:49:21 user nova-compute[75260]:     </rng>
Nov 27 04:49:21 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:49:21 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:49:21 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:49:21 user nova-compute[75260]:     </memballoon>
Nov 27 04:49:21 user nova-compute[75260]:   </devices>
Nov 27 04:49:21 user nova-compute[75260]: </domain>
Nov 27 04:49:21 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2031966221',display_name='tempest-AttachVolumeNegativeTest-server-2031966221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2031966221',id=28,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoJaNZ0zgjmRild6Z5cxzEnhy9R4Sm8sV/rbA0Snj7iJ4yAvU8HjLMKMaGD9hT5SxCvcAVug43+mBo6zjpyX/ig1MQlzJGW5kIHzIZvaY0rNM5XZb8ZbTHYu0MFOTewfQ==',key_name='tempest-keypair-1106994504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-jmuzvatq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=3079fe74-317c-4325-9667-45a6754af567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:56:60,bridge_name='br-int',has_traffic_filtering=True,id=a99a93fb-2492-43cd-be0b-04fbcf66e165,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99a93fb-24') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG os_vif [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:56:60,bridge_name='br-int',has_traffic_filtering=True,id=a99a93fb-2492-43cd-be0b-04fbcf66e165,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99a93fb-24') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ad1986b-e869-535d-87aa-e13f620c7a4a', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa99a93fb-24, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa99a93fb-24, col_values=(('qos', UUID('d7508d5f-23cb-4add-add5-d7de0ba09a9e')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa99a93fb-24, col_values=(('external_ids', {'iface-id': 'a99a93fb-2492-43cd-be0b-04fbcf66e165', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:56:60', 'vm-uuid': '3079fe74-317c-4325-9667-45a6754af567'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:21 user nova-compute[75260]: INFO os_vif [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:56:60,bridge_name='br-int',has_traffic_filtering=True,id=a99a93fb-2492-43cd-be0b-04fbcf66e165,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99a93fb-24')
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No VIF found with MAC fa:16:3e:98:56:60, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.network.neutron [req-a976e8b8-0cef-45da-bc92-12f5c4b59bca req-a9219e8d-36ec-4dd2-ab40-c8d9196dcea1 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Updated VIF entry in instance network info cache for port a99a93fb-2492-43cd-be0b-04fbcf66e165. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.network.neutron [req-a976e8b8-0cef-45da-bc92-12f5c4b59bca req-a9219e8d-36ec-4dd2-ab40-c8d9196dcea1 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Updating instance_info_cache with network_info: [{"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a976e8b8-0cef-45da-bc92-12f5c4b59bca req-a9219e8d-36ec-4dd2-ab40-c8d9196dcea1 service nova] Releasing lock "refresh_cache-3079fe74-317c-4325-9667-45a6754af567" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:21 user nova-compute[75260]: WARNING nova.compute.manager [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state active and task_state rescuing.
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:21 user nova-compute[75260]: WARNING nova.compute.manager [req-c97ce8f1-cc63-42bc-b5ae-10ccb1cdf20d req-22e8c81a-d537-417d-a460-afffc32c6308 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state active and task_state rescuing.
Nov 27 04:49:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:22 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8f00da81-a340-4f4a-8813-09874504493c tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:49:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-54c11e30-c778-46e9-9ec6-8eea95a57c4e req-4a2875ed-c5ca-4686-ae76-c2ccac5fcaf0 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received event network-vif-plugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-54c11e30-c778-46e9-9ec6-8eea95a57c4e req-4a2875ed-c5ca-4686-ae76-c2ccac5fcaf0 service nova] Acquiring lock "3079fe74-317c-4325-9667-45a6754af567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-54c11e30-c778-46e9-9ec6-8eea95a57c4e req-4a2875ed-c5ca-4686-ae76-c2ccac5fcaf0 service nova] Lock "3079fe74-317c-4325-9667-45a6754af567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-54c11e30-c778-46e9-9ec6-8eea95a57c4e req-4a2875ed-c5ca-4686-ae76-c2ccac5fcaf0 service nova] Lock "3079fe74-317c-4325-9667-45a6754af567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-54c11e30-c778-46e9-9ec6-8eea95a57c4e req-4a2875ed-c5ca-4686-ae76-c2ccac5fcaf0 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] No waiting events found dispatching network-vif-plugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:22 user nova-compute[75260]: WARNING nova.compute.manager [req-54c11e30-c778-46e9-9ec6-8eea95a57c4e req-4a2875ed-c5ca-4686-ae76-c2ccac5fcaf0 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received unexpected event network-vif-plugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 for instance with vm_state building and task_state spawning.
Nov 27 04:49:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-9f9b0244-9406-47a1-b6cc-ef851b513dbc req-4c093af7-851d-4515-bcad-1541447a1258 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received event network-vif-plugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9f9b0244-9406-47a1-b6cc-ef851b513dbc req-4c093af7-851d-4515-bcad-1541447a1258 service nova] Acquiring lock "3079fe74-317c-4325-9667-45a6754af567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9f9b0244-9406-47a1-b6cc-ef851b513dbc req-4c093af7-851d-4515-bcad-1541447a1258 service nova] Lock "3079fe74-317c-4325-9667-45a6754af567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9f9b0244-9406-47a1-b6cc-ef851b513dbc req-4c093af7-851d-4515-bcad-1541447a1258 service nova] Lock "3079fe74-317c-4325-9667-45a6754af567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-9f9b0244-9406-47a1-b6cc-ef851b513dbc req-4c093af7-851d-4515-bcad-1541447a1258 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] No waiting events found dispatching network-vif-plugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:24 user nova-compute[75260]: WARNING nova.compute.manager [req-9f9b0244-9406-47a1-b6cc-ef851b513dbc req-4c093af7-851d-4515-bcad-1541447a1258 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received unexpected event network-vif-plugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 for instance with vm_state building and task_state spawning.
Nov 27 04:49:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:49:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:49:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 3079fe74-317c-4325-9667-45a6754af567] Instance spawned successfully.
Nov 27 04:49:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:49:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:25 user nova-compute[75260]: INFO nova.compute.manager [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 27 04:49:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:49:25 user nova-compute[75260]: INFO nova.compute.manager [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Took 6.33 seconds to build instance.
Nov 27 04:49:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-399fba3b-7c70-4308-8154-1fc592b27353 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.442s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:33 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.compute.manager [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:49:39 user nova-compute[75260]: INFO nova.compute.claims [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Claim successful on node user
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.compute.manager [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.compute.manager [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.network.neutron [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:49:39 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.compute.manager [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.compute.manager [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:49:39 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Creating image(s)
Nov 27 04:49:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "/opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "/opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "/opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:39 user nova-compute[75260]: DEBUG nova.policy [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cbd63730ab84fa3aa9a05b06194ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8a8bd85b234d8e82487ead1232a644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk 1073741824" returned: 0 in 0.054s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG nova.network.neutron [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Successfully created port: b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Cannot resize image /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Ensure instance console log exists: /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:40 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75260) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.network.neutron [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Successfully updated port: b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "refresh_cache-06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquired lock "refresh_cache-06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.network.neutron [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-e44dbe25-2a04-4f85-8d4c-164da8a1f3a6 req-53f3191a-75d4-42aa-a8ba-a3ba9e64adb6 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received event network-changed-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-e44dbe25-2a04-4f85-8d4c-164da8a1f3a6 req-53f3191a-75d4-42aa-a8ba-a3ba9e64adb6 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Refreshing instance network info cache due to event network-changed-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e44dbe25-2a04-4f85-8d4c-164da8a1f3a6 req-53f3191a-75d4-42aa-a8ba-a3ba9e64adb6 service nova] Acquiring lock "refresh_cache-06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.network.neutron [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.network.neutron [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Updating instance_info_cache with network_info: [{"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Releasing lock "refresh_cache-06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.compute.manager [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Instance network_info: |[{"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e44dbe25-2a04-4f85-8d4c-164da8a1f3a6 req-53f3191a-75d4-42aa-a8ba-a3ba9e64adb6 service nova] Acquired lock "refresh_cache-06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.network.neutron [req-e44dbe25-2a04-4f85-8d4c-164da8a1f3a6 req-53f3191a-75d4-42aa-a8ba-a3ba9e64adb6 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Refreshing network info cache for port b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Start _get_guest_xml network_info=[{"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:49:41 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:49:41 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1777132672',display_name='tempest-AttachVolumeTestJSON-server-1777132672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1777132672',id=29,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRrWocvrzj0wpRlpge4L2WZXMC2nLVE7223A1NSVX8DYDCR1B5b5CJ64cgLm/clNiqTFlCpXZfqV5DSSIsGxGDlh3aetA3Xt32CwY99EvYyUaY49cZI8uPmtW86Wao/Nw==',key_name='tempest-keypair-2040186399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-rzc1ueqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:49:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=06c8aeb2-c1a1-4e84-b8e2-39755a779dc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2e:2b,bridge_name='br-int',has_traffic_filtering=True,id=b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08e0a76-9a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.objects.instance [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'pci_devices' on Instance uuid 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:49:41 user nova-compute[75260]:   <uuid>06c8aeb2-c1a1-4e84-b8e2-39755a779dc5</uuid>
Nov 27 04:49:41 user nova-compute[75260]:   <name>instance-0000001d</name>
Nov 27 04:49:41 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:49:41 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:49:41 user nova-compute[75260]:   <metadata>
Nov 27 04:49:41 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:49:41 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:49:41 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeTestJSON-server-1777132672</nova:name>
Nov 27 04:49:41 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:49:41</nova:creationTime>
Nov 27 04:49:41 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:49:41 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:49:41 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:49:41 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:49:41 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:49:41 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:49:41 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:49:41 user nova-compute[75260]:       <nova:owner>
Nov 27 04:49:41 user nova-compute[75260]:         <nova:user uuid="1cbd63730ab84fa3aa9a05b06194ad4a">tempest-AttachVolumeTestJSON-2145472694-project-member</nova:user>
Nov 27 04:49:41 user nova-compute[75260]:         <nova:project uuid="ea8a8bd85b234d8e82487ead1232a644">tempest-AttachVolumeTestJSON-2145472694</nova:project>
Nov 27 04:49:41 user nova-compute[75260]:       </nova:owner>
Nov 27 04:49:41 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:49:41 user nova-compute[75260]:       <nova:ports>
Nov 27 04:49:41 user nova-compute[75260]:         <nova:port uuid="b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95">
Nov 27 04:49:41 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 04:49:41 user nova-compute[75260]:         </nova:port>
Nov 27 04:49:41 user nova-compute[75260]:       </nova:ports>
Nov 27 04:49:41 user nova-compute[75260]:     </nova:instance>
Nov 27 04:49:41 user nova-compute[75260]:   </metadata>
Nov 27 04:49:41 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:49:41 user nova-compute[75260]:     <system>
Nov 27 04:49:41 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:49:41 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:49:41 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:49:41 user nova-compute[75260]:       <entry name="serial">06c8aeb2-c1a1-4e84-b8e2-39755a779dc5</entry>
Nov 27 04:49:41 user nova-compute[75260]:       <entry name="uuid">06c8aeb2-c1a1-4e84-b8e2-39755a779dc5</entry>
Nov 27 04:49:41 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:49:41 user nova-compute[75260]:     </system>
Nov 27 04:49:41 user nova-compute[75260]:   </sysinfo>
Nov 27 04:49:41 user nova-compute[75260]:   <os>
Nov 27 04:49:41 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:49:41 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:49:41 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:49:41 user nova-compute[75260]:   </os>
Nov 27 04:49:41 user nova-compute[75260]:   <features>
Nov 27 04:49:41 user nova-compute[75260]:     <acpi/>
Nov 27 04:49:41 user nova-compute[75260]:     <apic/>
Nov 27 04:49:41 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:49:41 user nova-compute[75260]:   </features>
Nov 27 04:49:41 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:49:41 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:49:41 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:49:41 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:49:41 user nova-compute[75260]:   </clock>
Nov 27 04:49:41 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:49:41 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:49:41 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:49:41 user nova-compute[75260]:   </cpu>
Nov 27 04:49:41 user nova-compute[75260]:   <devices>
Nov 27 04:49:41 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:49:41 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:49:41 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk"/>
Nov 27 04:49:41 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:49:41 user nova-compute[75260]:     </disk>
Nov 27 04:49:41 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:49:41 user nova-compute[75260]:       <mac address="fa:16:3e:d2:2e:2b"/>
Nov 27 04:49:41 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:49:41 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:49:41 user nova-compute[75260]:       <target dev="tapb08e0a76-9a"/>
Nov 27 04:49:41 user nova-compute[75260]:     </interface>
Nov 27 04:49:41 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:49:41 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/console.log" append="off"/>
Nov 27 04:49:41 user nova-compute[75260]:     </serial>
Nov 27 04:49:41 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:49:41 user nova-compute[75260]:     <video>
Nov 27 04:49:41 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:49:41 user nova-compute[75260]:     </video>
Nov 27 04:49:41 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:49:41 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:49:41 user nova-compute[75260]:     </rng>
Nov 27 04:49:41 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:49:41 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:49:41 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:49:41 user nova-compute[75260]:     </memballoon>
Nov 27 04:49:41 user nova-compute[75260]:   </devices>
Nov 27 04:49:41 user nova-compute[75260]: </domain>
Nov 27 04:49:41 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1777132672',display_name='tempest-AttachVolumeTestJSON-server-1777132672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1777132672',id=29,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRrWocvrzj0wpRlpge4L2WZXMC2nLVE7223A1NSVX8DYDCR1B5b5CJ64cgLm/clNiqTFlCpXZfqV5DSSIsGxGDlh3aetA3Xt32CwY99EvYyUaY49cZI8uPmtW86Wao/Nw==',key_name='tempest-keypair-2040186399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-rzc1ueqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:49:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=06c8aeb2-c1a1-4e84-b8e2-39755a779dc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2e:2b,bridge_name='br-int',has_traffic_filtering=True,id=b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08e0a76-9a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG os_vif [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2e:2b,bridge_name='br-int',has_traffic_filtering=True,id=b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08e0a76-9a') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0b11032-a597-53da-a6c6-699a6bb59894', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb08e0a76-9a, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb08e0a76-9a, col_values=(('qos', UUID('4cba910e-336d-49c3-8882-f4729611565f')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb08e0a76-9a, col_values=(('external_ids', {'iface-id': 'b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:2e:2b', 'vm-uuid': '06c8aeb2-c1a1-4e84-b8e2-39755a779dc5'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:41 user nova-compute[75260]: INFO os_vif [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2e:2b,bridge_name='br-int',has_traffic_filtering=True,id=b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08e0a76-9a')
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No VIF found with MAC fa:16:3e:d2:2e:2b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG nova.network.neutron [req-e44dbe25-2a04-4f85-8d4c-164da8a1f3a6 req-53f3191a-75d4-42aa-a8ba-a3ba9e64adb6 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Updated VIF entry in instance network info cache for port b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG nova.network.neutron [req-e44dbe25-2a04-4f85-8d4c-164da8a1f3a6 req-53f3191a-75d4-42aa-a8ba-a3ba9e64adb6 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Updating instance_info_cache with network_info: [{"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e44dbe25-2a04-4f85-8d4c-164da8a1f3a6 req-53f3191a-75d4-42aa-a8ba-a3ba9e64adb6 service nova] Releasing lock "refresh_cache-06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'flavor' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:42 user nova-compute[75260]: INFO nova.compute.manager [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Attaching volume 6b10a262-7bfe-446c-b417-1e10d73c3117 to /dev/vdb
Nov 27 04:49:42 user nova-compute[75260]: DEBUG os_brick.utils [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c913eb6-30d0-4892-8623-ef6341282aee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebefb62d-7de3-4bf0-ba7d-8beb82443405]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895bad9-7bb4-45ea-afea-52740325436a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f3f576-06fc-4eee-a52b-14c7dda764fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:49:43 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:49:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a410d62a-13a1-45b9-8b35-34358259d344]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG os_brick.utils [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updating existing volume attachment record: b4f0c995-911f-4e09-8517-98d7cfd2dd13 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-1b85e8f9-d033-4c7a-a344-f44195516529 req-74b5d329-99bb-40de-8ef1-6b793ec4a390 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received event network-vif-plugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1b85e8f9-d033-4c7a-a344-f44195516529 req-74b5d329-99bb-40de-8ef1-6b793ec4a390 service nova] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1b85e8f9-d033-4c7a-a344-f44195516529 req-74b5d329-99bb-40de-8ef1-6b793ec4a390 service nova] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1b85e8f9-d033-4c7a-a344-f44195516529 req-74b5d329-99bb-40de-8ef1-6b793ec4a390 service nova] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-1b85e8f9-d033-4c7a-a344-f44195516529 req-74b5d329-99bb-40de-8ef1-6b793ec4a390 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] No waiting events found dispatching network-vif-plugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:43 user nova-compute[75260]: WARNING nova.compute.manager [req-1b85e8f9-d033-4c7a-a344-f44195516529 req-74b5d329-99bb-40de-8ef1-6b793ec4a390 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received unexpected event network-vif-plugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 for instance with vm_state building and task_state spawning.
Nov 27 04:49:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:49:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-d0364679-4db1-4da8-bce8-80eea41feb13" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:49:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-d0364679-4db1-4da8-bce8-80eea41feb13" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:49:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:49:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Updating instance_info_cache with network_info: [{"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:49:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-d0364679-4db1-4da8-bce8-80eea41feb13" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:49:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:49:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:49:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Instance spawned successfully.
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-314e9963-1ad5-41f3-9743-8c272b4e6e83 req-96ec609d-514d-4691-8934-f0876a4eb8db service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received event network-vif-plugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-314e9963-1ad5-41f3-9743-8c272b4e6e83 req-96ec609d-514d-4691-8934-f0876a4eb8db service nova] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-314e9963-1ad5-41f3-9743-8c272b4e6e83 req-96ec609d-514d-4691-8934-f0876a4eb8db service nova] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-314e9963-1ad5-41f3-9743-8c272b4e6e83 req-96ec609d-514d-4691-8934-f0876a4eb8db service nova] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-314e9963-1ad5-41f3-9743-8c272b4e6e83 req-96ec609d-514d-4691-8934-f0876a4eb8db service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] No waiting events found dispatching network-vif-plugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:45 user nova-compute[75260]: WARNING nova.compute.manager [req-314e9963-1ad5-41f3-9743-8c272b4e6e83 req-96ec609d-514d-4691-8934-f0876a4eb8db service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received unexpected event network-vif-plugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 for instance with vm_state building and task_state spawning.
Nov 27 04:49:45 user nova-compute[75260]: INFO nova.compute.manager [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 27 04:49:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:49:45 user nova-compute[75260]: INFO nova.compute.manager [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Took 6.55 seconds to build instance.
Nov 27 04:49:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-258e806f-efd0-41ae-9e31-0c7c331f5e43 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.654s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:45 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:46 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:49:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqehPLBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:49:49 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:49:49 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:49:49 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf9bc75-96b1-43b2-b8c5-b4c9c803fcb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:49:49 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43fcdfb-06a0-43c6-b5a9-df188d0e0683]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117] added
Nov 27 04:49:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa9755a-eabe-4cc9-8f00-37febf2d127c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba663c3f-0515-4361-a226-92f60c15c5bb]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqehPLBo {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqehPLBo" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c429ab3e-cffd-4dfa-84d9-5fb9d0932034]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CqehPLBo'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5909d997-67db-4d2a-b0df-67155c23e967]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cd977f-3cce-4f7f-ae22-e5c5504783f6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:49:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:49:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9450953b-1266-4650-ac73-0b73aab4684a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117, portal: 172.16.0.220,3260]
Nov 27 04:49:49 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117, portal: 172.16.0.220,3260] successful.
Nov 27 04:49:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc00f51-c263-4f36-b4e5-9e5e7ec01eea]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47e0f81-47b7-44e3-b4e1-83bb764c5217]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:49:49 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:49:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:49:49 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:49:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f393f350-5454-4048-87a3-ce950d5f5061]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqehPLBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26633646239303238', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633646239303238', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'flavor' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:49:50 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:49:50 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:49:50 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:49:50 user nova-compute[75260]:   <serial>6b10a262-7bfe-446c-b417-1e10d73c3117</serial>
Nov 27 04:49:50 user nova-compute[75260]: </disk>
Nov 27 04:49:50 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] No VIF found with MAC fa:16:3e:68:c8:81, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:49:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.546s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e1510e2d-7c74-4bef-8278-b1a4cb7e12a9 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.844s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:52 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:49:52 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7592MB free_disk=25.419513702392578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d0364679-4db1-4da8-bce8-80eea41feb13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3079fe74-317c-4325-9667-45a6754af567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing inventories for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating ProviderTree inventory for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing aggregate associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, aggregates: None {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing trait associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.779s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] There are 0 instances to clean {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 04:49:52 user nova-compute[75260]: INFO nova.compute.manager [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Rescuing
Nov 27 04:49:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquired lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:49:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updating instance_info_cache with network_info: [{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Releasing lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-53238f7f-6888-4e38-be66-3d620211cfe1 req-58d5a2f4-5643-4ef8-b618-0459ab042f55 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-unplugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-53238f7f-6888-4e38-be66-3d620211cfe1 req-58d5a2f4-5643-4ef8-b618-0459ab042f55 service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-53238f7f-6888-4e38-be66-3d620211cfe1 req-58d5a2f4-5643-4ef8-b618-0459ab042f55 service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-53238f7f-6888-4e38-be66-3d620211cfe1 req-58d5a2f4-5643-4ef8-b618-0459ab042f55 service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-53238f7f-6888-4e38-be66-3d620211cfe1 req-58d5a2f4-5643-4ef8-b618-0459ab042f55 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-unplugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:53 user nova-compute[75260]: WARNING nova.compute.manager [req-53238f7f-6888-4e38-be66-3d620211cfe1 req-58d5a2f4-5643-4ef8-b618-0459ab042f55 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-unplugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state active and task_state rescuing.
Nov 27 04:49:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Instance destroyed successfully.
Nov 27 04:49:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Attempting a stable device rescue
Nov 27 04:49:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75260) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 04:49:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Instance directory exists: not creating {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 04:49:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Creating image(s)
Nov 27 04:49:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:54 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'trusted_certs' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e.part --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:49:55 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:49:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e.part --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:55 user nova-compute[75260]: DEBUG nova.virt.images [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] fe7c625e-9d1b-4878-9224-10cb321e9748 was qcow2, converting to raw {{(pid=75260) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 04:49:55 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 04:49:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e.part /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e.converted {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-0b69ef27-d921-4cbb-a355-55ca3b8eec8b req-eed06621-3c32-470e-a71b-60e76904c782 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0b69ef27-d921-4cbb-a355-55ca3b8eec8b req-eed06621-3c32-470e-a71b-60e76904c782 service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0b69ef27-d921-4cbb-a355-55ca3b8eec8b req-eed06621-3c32-470e-a71b-60e76904c782 service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0b69ef27-d921-4cbb-a355-55ca3b8eec8b req-eed06621-3c32-470e-a71b-60e76904c782 service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-0b69ef27-d921-4cbb-a355-55ca3b8eec8b req-eed06621-3c32-470e-a71b-60e76904c782 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:56 user nova-compute[75260]: WARNING nova.compute.manager [req-0b69ef27-d921-4cbb-a355-55ca3b8eec8b req-eed06621-3c32-470e-a71b-60e76904c782 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state active and task_state rescuing.
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e.part /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e.converted" returned: 0 in 0.713s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e.converted --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.043s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e,backing_fmt=raw /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.rescue {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e,backing_fmt=raw /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.rescue" returned: 0 in 0.052s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'migration_context' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.objects.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Object Instance<57ee8ff0-df13-4f15-96a0-c324b10dd9a7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Start _get_guest_xml network_info=[{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "vif_mac": "fa:16:3e:68:c8:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fe7c625e-9d1b-4878-9224-10cb321e9748', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'b4f0c995-911f-4e09-8517-98d7cfd2dd13', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqehPLBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '57ee8ff0-df13-4f15-96a0-c324b10dd9a7', 'attached_at': '', 'detached_at': '', 'volume_id': '6b10a262-7bfe-446c-b417-1e10d73c3117', 'serial': '6b10a262-7bfe-446c-b417-1e10d73c3117'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'resources' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.objects.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Object Instance<57ee8ff0-df13-4f15-96a0-c324b10dd9a7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'numa_topology' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.objects.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Object Instance<57ee8ff0-df13-4f15-96a0-c324b10dd9a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:49:56 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:49:56 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.objects.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Object Instance<57ee8ff0-df13-4f15-96a0-c324b10dd9a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqehPLBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:49:56 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:49:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:49:56 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:49:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:49:56 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beecd92-4204-432a-bc93-10139cfd4f0c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = CqehPLBo\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 27 04:49:56 user nova-compute[75260]: node.name = iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117
Nov 27 04:49:56 user nova-compute[75260]: node.tpgt = -1
Nov 27 04:49:56 user nova-compute[75260]: node.startup = automatic
Nov 27 04:49:56 user nova-compute[75260]: node.leading_login = No
Nov 27 04:49:56 user nova-compute[75260]: iface.iscsi_ifacename = default
Nov 27 04:49:56 user nova-compute[75260]: iface.net_ifacename = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.ipaddress = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.prefix_len = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.hwaddress = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.transport_name = tcp
Nov 27 04:49:56 user nova-compute[75260]: iface.initiatorname = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.state = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.vlan_id = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.vlan_priority = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.vlan_state = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.iface_num = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.mtu = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.port = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.bootproto = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.subnet_mask = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.gateway = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.dhcp_alt_client_id_state = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.dhcp_alt_client_id = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.dhcp_dns = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.dhcp_learn_iqn = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.dhcp_req_vendor_id_state = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.dhcp_vendor_id_state = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.dhcp_vendor_id = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.dhcp_slp_da = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.fragmentation = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.gratuitous_arp = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.incoming_forwarding = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.tos_state = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.tos = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.ttl = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.delayed_ack = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.tcp_nagle = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.tcp_wsf_state = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.tcp_wsf = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.tcp_timer_scale = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.tcp_timestamp = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.redirect = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.def_task_mgmt_timeout = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.header_digest = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.data_digest = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.immediate_data = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.initial_r2t = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.data_seq_inorder = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.data_pdu_inorder = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.erl = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.max_receive_data_len = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.first_burst_len = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.max_outstanding_r2t = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.max_burst_len = 0
Nov 27 04:49:56 user nova-compute[75260]: iface.chap_auth = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.bidi_chap = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.strict_login_compliance = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.discovery_auth = <empty>
Nov 27 04:49:56 user nova-compute[75260]: iface.discovery_logout = <empty>
Nov 27 04:49:56 user nova-compute[75260]: node.discovery_address = <empty>
Nov 27 04:49:56 user nova-compute[75260]: node.discovery_port = 0
Nov 27 04:49:56 user nova-compute[75260]: node.discovery_type = static
Nov 27 04:49:56 user nova-compute[75260]: node.session.initial_cmdsn = 0
Nov 27 04:49:56 user nova-compute[75260]: node.session.initial_login_retry_max = 8
Nov 27 04:49:56 user nova-compute[75260]: node.session.xmit_thread_priority = -20
Nov 27 04:49:56 user nova-compute[75260]: node.session.cmds_max = 128
Nov 27 04:49:56 user nova-compute[75260]: node.session.queue_depth = 32
Nov 27 04:49:56 user nova-compute[75260]: node.session.nr_sessions = 1
Nov 27 04:49:56 user nova-compute[75260]: node.session.auth.authmethod = CHAP
Nov 27 04:49:56 user nova-compute[75260]: node.session.auth.username = CqehPLBo
Nov 27 04:49:56 user nova-compute[75260]: node.session.auth.password = ***
Nov 27 04:49:56 user nova-compute[75260]: node.session.auth.username_in = <empty>
Nov 27 04:49:56 user nova-compute[75260]: node.session.auth.password_in = <empty>
Nov 27 04:49:56 user nova-compute[75260]: node.session.auth.chap_algs = MD5
Nov 27 04:49:56 user nova-compute[75260]: node.session.timeo.replacement_timeout = 120
Nov 27 04:49:56 user nova-compute[75260]: node.session.err_timeo.abort_timeout = 15
Nov 27 04:49:56 user nova-compute[75260]: node.session.err_timeo.lu_reset_timeout = 30
Nov 27 04:49:56 user nova-compute[75260]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 27 04:49:56 user nova-compute[75260]: node.session.err_timeo.host_reset_timeout = 60
Nov 27 04:49:56 user nova-compute[75260]: node.session.iscsi.FastAbort = Yes
Nov 27 04:49:56 user nova-compute[75260]: node.session.iscsi.InitialR2T = No
Nov 27 04:49:56 user nova-compute[75260]: node.session.iscsi.ImmediateData = Yes
Nov 27 04:49:56 user nova-compute[75260]: node.session.iscsi.FirstBurstLength = 262144
Nov 27 04:49:56 user nova-compute[75260]: node.session.iscsi.MaxBurstLength = 16776192
Nov 27 04:49:56 user nova-compute[75260]: node.session.iscsi.DefaultTime2Retain = 0
Nov 27 04:49:56 user nova-compute[75260]: node.session.iscsi.DefaultTime2Wait = 2
Nov 27 04:49:56 user nova-compute[75260]: node.session.iscsi.MaxConnections = 1
Nov 27 04:49:56 user nova-compute[75260]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 27 04:49:56 user nova-compute[75260]: node.session.iscsi.ERL = 0
Nov 27 04:49:56 user nova-compute[75260]: node.session.scan = manual
Nov 27 04:49:56 user nova-compute[75260]: node.session.reopen_max = 0
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].address = 172.16.0.220
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].port = 3260
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].startup = manual
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].tcp.window_size = 524288
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].tcp.type_of_service = 0
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].timeo.logout_timeout = 15
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].timeo.login_timeout = 15
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].timeo.auth_timeout = 45
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].timeo.noop_out_interval = 5
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].timeo.noop_out_timeout = 5
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].iscsi.HeaderDigest = None
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].iscsi.DataDigest = None
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].iscsi.IFMarker = No
Nov 27 04:49:56 user nova-compute[75260]: node.conn[0].iscsi.OFMarker = No
Nov 27 04:49:56 user nova-compute[75260]: # END RECORD
Nov 27 04:49:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8703e8-7155-4f90-a0f2-c160ce2e1bfd]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8018447a-80f1-42ab-aed8-208e04656953]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqehPLBo {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqehPLBo" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e831a43-ce9f-4a48-885e-85c97215bd87]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CqehPLBo'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3e6f25-aa87-4ded-9a29-2d1cc581ccf6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dc67a3-a7d2-4776-8812-2cd97b8f3b53]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:49:57 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:49:57 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:49:57 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:49:57 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.135s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] HCTL ('34', '0', '0', 0) found on session 27 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e895c8be-1267-4a0b-ae12-6ded63436c89]: (4, ('0 0 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Searching for a device in session 27 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqehPLBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.160s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] <== connect_volume: return (162ms) {'type': 'block', 'scsi_wwn': '26633646239303238', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633646239303238', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1343339764',display_name='tempest-ServerStableDeviceRescueTest-server-1343339764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1343339764',id=23,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTQN+/2CjAEBmT4+S+1zo64Z0W5v1lvMJnT95nxxyeuCKn1YzWu5h2Sgpil050tma7PbOyqmOUnEFI32sPfr1Lq9oY/oSHuA9d3TuhQeiSZENua0tyJQOXqlfYvzCbiAw==',key_name='tempest-keypair-817121387',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efcdc0a7701245aaae5d18694ec3e0e4',ramdisk_id='',reservation_id='r-1j1jr746',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1298117882',owner_user_name='tempest-ServerStableDeviceRescueTest-1298117882-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:47:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbc381d6509448db6f2b23ec2a609d2',uuid=57ee8ff0-df13-4f15-96a0-c324b10dd9a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "vif_mac": "fa:16:3e:68:c8:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Converting VIF {"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "vif_mac": "fa:16:3e:68:c8:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:c8:81,bridge_name='br-int',has_traffic_filtering=True,id=08fcec14-f146-4deb-861b-02af609bfd4e,network=Network(eaa843ad-ee5c-45a7-ad9f-103049904426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fcec14-f1') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'pci_devices' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.objects.base [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Object Instance<57ee8ff0-df13-4f15-96a0-c324b10dd9a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:49:57 user nova-compute[75260]:   <uuid>57ee8ff0-df13-4f15-96a0-c324b10dd9a7</uuid>
Nov 27 04:49:57 user nova-compute[75260]:   <name>instance-00000017</name>
Nov 27 04:49:57 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:49:57 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:49:57 user nova-compute[75260]:   <metadata>
Nov 27 04:49:57 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:49:57 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:49:57 user nova-compute[75260]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1343339764</nova:name>
Nov 27 04:49:57 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:49:56</nova:creationTime>
Nov 27 04:49:57 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:49:57 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:49:57 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:49:57 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:49:57 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:49:57 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:49:57 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:49:57 user nova-compute[75260]:       <nova:owner>
Nov 27 04:49:57 user nova-compute[75260]:         <nova:user uuid="7bbc381d6509448db6f2b23ec2a609d2">tempest-ServerStableDeviceRescueTest-1298117882-project-member</nova:user>
Nov 27 04:49:57 user nova-compute[75260]:         <nova:project uuid="efcdc0a7701245aaae5d18694ec3e0e4">tempest-ServerStableDeviceRescueTest-1298117882</nova:project>
Nov 27 04:49:57 user nova-compute[75260]:       </nova:owner>
Nov 27 04:49:57 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:49:57 user nova-compute[75260]:       <nova:ports>
Nov 27 04:49:57 user nova-compute[75260]:         <nova:port uuid="08fcec14-f146-4deb-861b-02af609bfd4e">
Nov 27 04:49:57 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 04:49:57 user nova-compute[75260]:         </nova:port>
Nov 27 04:49:57 user nova-compute[75260]:       </nova:ports>
Nov 27 04:49:57 user nova-compute[75260]:     </nova:instance>
Nov 27 04:49:57 user nova-compute[75260]:   </metadata>
Nov 27 04:49:57 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:49:57 user nova-compute[75260]:     <system>
Nov 27 04:49:57 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:49:57 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:49:57 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:49:57 user nova-compute[75260]:       <entry name="serial">57ee8ff0-df13-4f15-96a0-c324b10dd9a7</entry>
Nov 27 04:49:57 user nova-compute[75260]:       <entry name="uuid">57ee8ff0-df13-4f15-96a0-c324b10dd9a7</entry>
Nov 27 04:49:57 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:49:57 user nova-compute[75260]:     </system>
Nov 27 04:49:57 user nova-compute[75260]:   </sysinfo>
Nov 27 04:49:57 user nova-compute[75260]:   <os>
Nov 27 04:49:57 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:49:57 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:49:57 user nova-compute[75260]:   </os>
Nov 27 04:49:57 user nova-compute[75260]:   <features>
Nov 27 04:49:57 user nova-compute[75260]:     <acpi/>
Nov 27 04:49:57 user nova-compute[75260]:     <apic/>
Nov 27 04:49:57 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:49:57 user nova-compute[75260]:   </features>
Nov 27 04:49:57 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:49:57 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:49:57 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:49:57 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:49:57 user nova-compute[75260]:   </clock>
Nov 27 04:49:57 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:49:57 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:49:57 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:49:57 user nova-compute[75260]:   </cpu>
Nov 27 04:49:57 user nova-compute[75260]:   <devices>
Nov 27 04:49:57 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:49:57 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:49:57 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk"/>
Nov 27 04:49:57 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:49:57 user nova-compute[75260]:     </disk>
Nov 27 04:49:57 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:49:57 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:49:57 user nova-compute[75260]:       <source dev="/dev/sdc"/>
Nov 27 04:49:57 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:49:57 user nova-compute[75260]:       <serial>6b10a262-7bfe-446c-b417-1e10d73c3117</serial>
Nov 27 04:49:57 user nova-compute[75260]:     </disk>
Nov 27 04:49:57 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:49:57 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:49:57 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.rescue"/>
Nov 27 04:49:57 user nova-compute[75260]:       <target dev="vdc" bus="virtio"/>
Nov 27 04:49:57 user nova-compute[75260]:       <boot order="1"/>
Nov 27 04:49:57 user nova-compute[75260]:     </disk>
Nov 27 04:49:57 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:49:57 user nova-compute[75260]:       <mac address="fa:16:3e:68:c8:81"/>
Nov 27 04:49:57 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:49:57 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:49:57 user nova-compute[75260]:       <target dev="tap08fcec14-f1"/>
Nov 27 04:49:57 user nova-compute[75260]:     </interface>
Nov 27 04:49:57 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:49:57 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/console.log" append="off"/>
Nov 27 04:49:57 user nova-compute[75260]:     </serial>
Nov 27 04:49:57 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:49:57 user nova-compute[75260]:     <video>
Nov 27 04:49:57 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:49:57 user nova-compute[75260]:     </video>
Nov 27 04:49:57 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:49:57 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:49:57 user nova-compute[75260]:     </rng>
Nov 27 04:49:57 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:49:57 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:49:57 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:49:57 user nova-compute[75260]:     </memballoon>
Nov 27 04:49:57 user nova-compute[75260]:   </devices>
Nov 27 04:49:57 user nova-compute[75260]: </domain>
Nov 27 04:49:57 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:49:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Instance destroyed successfully.
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:49:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] No VIF found with MAC fa:16:3e:68:c8:81, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:49:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-f535f38f-0601-46bc-b1f8-8b1d9d96daa7 req-232c3324-5cf1-49b2-b7a4-fc1ea85eb4da service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:49:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f535f38f-0601-46bc-b1f8-8b1d9d96daa7 req-232c3324-5cf1-49b2-b7a4-fc1ea85eb4da service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:49:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f535f38f-0601-46bc-b1f8-8b1d9d96daa7 req-232c3324-5cf1-49b2-b7a4-fc1ea85eb4da service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:49:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f535f38f-0601-46bc-b1f8-8b1d9d96daa7 req-232c3324-5cf1-49b2-b7a4-fc1ea85eb4da service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:49:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-f535f38f-0601-46bc-b1f8-8b1d9d96daa7 req-232c3324-5cf1-49b2-b7a4-fc1ea85eb4da service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:49:58 user nova-compute[75260]: WARNING nova.compute.manager [req-f535f38f-0601-46bc-b1f8-8b1d9d96daa7 req-232c3324-5cf1-49b2-b7a4-fc1ea85eb4da service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state active and task_state rescuing.
Nov 27 04:49:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:49:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e04f630e-6aa8-4c6a-8c42-c66f3ba94701 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:50:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-b56e286d-2e4a-492b-8192-56fcbcf80d92 req-409490d7-a183-4789-8bfa-17b2945266bc service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:50:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b56e286d-2e4a-492b-8192-56fcbcf80d92 req-409490d7-a183-4789-8bfa-17b2945266bc service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b56e286d-2e4a-492b-8192-56fcbcf80d92 req-409490d7-a183-4789-8bfa-17b2945266bc service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b56e286d-2e4a-492b-8192-56fcbcf80d92 req-409490d7-a183-4789-8bfa-17b2945266bc service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-b56e286d-2e4a-492b-8192-56fcbcf80d92 req-409490d7-a183-4789-8bfa-17b2945266bc service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:50:00 user nova-compute[75260]: WARNING nova.compute.manager [req-b56e286d-2e4a-492b-8192-56fcbcf80d92 req-409490d7-a183-4789-8bfa-17b2945266bc service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state active and task_state rescuing.
Nov 27 04:50:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:50:05 user nova-compute[75260]: INFO nova.compute.claims [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Claim successful on node user
Nov 27 04:50:05 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG nova.network.neutron [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:50:05 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:50:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG nova.policy [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71baa1a857c5458ea2d03515ea2ccaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a344ddbabc8e48e9987d8aa73042821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:50:05 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Creating image(s)
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "/opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "/opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "/opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk 1073741824" returned: 0 in 0.049s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG nova.network.neutron [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Successfully created port: 3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Cannot resize image /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Ensure instance console log exists: /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Successfully updated port: 3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "refresh_cache-97fdc474-4f43-40fa-b33f-a7e1e380f4ec" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquired lock "refresh_cache-97fdc474-4f43-40fa-b33f-a7e1e380f4ec" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-da48472c-01fb-4d27-80f6-1dc5e7b69fd2 req-6fa793b9-61e5-4809-816f-602f8831cd8f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-changed-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-da48472c-01fb-4d27-80f6-1dc5e7b69fd2 req-6fa793b9-61e5-4809-816f-602f8831cd8f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Refreshing instance network info cache due to event network-changed-3ee2fcfd-34f7-45ae-b191-e8459d03647b. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-da48472c-01fb-4d27-80f6-1dc5e7b69fd2 req-6fa793b9-61e5-4809-816f-602f8831cd8f service nova] Acquiring lock "refresh_cache-97fdc474-4f43-40fa-b33f-a7e1e380f4ec" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Updating instance_info_cache with network_info: [{"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Releasing lock "refresh_cache-97fdc474-4f43-40fa-b33f-a7e1e380f4ec" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Instance network_info: |[{"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-da48472c-01fb-4d27-80f6-1dc5e7b69fd2 req-6fa793b9-61e5-4809-816f-602f8831cd8f service nova] Acquired lock "refresh_cache-97fdc474-4f43-40fa-b33f-a7e1e380f4ec" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-da48472c-01fb-4d27-80f6-1dc5e7b69fd2 req-6fa793b9-61e5-4809-816f-602f8831cd8f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Refreshing network info cache for port 3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Start _get_guest_xml network_info=[{"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:50:07 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:50:07 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-195716123',display_name='tempest-tempest.common.compute-instance-195716123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-195716123',id=30,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4R7s2prxxnZaQ+FL9NIcHHXMgfD6VF3HAU7eh7ww4DCPun1aOULgPRw6EAugomVlJUlPfVA9bor4qx9I5jy6H2NQrtP0cswCG82jNOmi6CoeOEhcRtUcgxt3wrB3pMsw==',key_name='tempest-keypair-1968778781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-79585enr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=97fdc474-4f43-40fa-b33f-a7e1e380f4ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.objects.instance [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'pci_devices' on Instance uuid 97fdc474-4f43-40fa-b33f-a7e1e380f4ec {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:50:07 user nova-compute[75260]:   <uuid>97fdc474-4f43-40fa-b33f-a7e1e380f4ec</uuid>
Nov 27 04:50:07 user nova-compute[75260]:   <name>instance-0000001e</name>
Nov 27 04:50:07 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:50:07 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:50:07 user nova-compute[75260]:   <metadata>
Nov 27 04:50:07 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:50:07 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:50:07 user nova-compute[75260]:       <nova:name>tempest-tempest.common.compute-instance-195716123</nova:name>
Nov 27 04:50:07 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:50:07</nova:creationTime>
Nov 27 04:50:07 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:50:07 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:50:07 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:50:07 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:50:07 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:50:07 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:50:07 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:50:07 user nova-compute[75260]:       <nova:owner>
Nov 27 04:50:07 user nova-compute[75260]:         <nova:user uuid="71baa1a857c5458ea2d03515ea2ccaf3">tempest-ServerActionsTestOtherA-678795315-project-member</nova:user>
Nov 27 04:50:07 user nova-compute[75260]:         <nova:project uuid="a344ddbabc8e48e9987d8aa73042821a">tempest-ServerActionsTestOtherA-678795315</nova:project>
Nov 27 04:50:07 user nova-compute[75260]:       </nova:owner>
Nov 27 04:50:07 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:50:07 user nova-compute[75260]:       <nova:ports>
Nov 27 04:50:07 user nova-compute[75260]:         <nova:port uuid="3ee2fcfd-34f7-45ae-b191-e8459d03647b">
Nov 27 04:50:07 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 04:50:07 user nova-compute[75260]:         </nova:port>
Nov 27 04:50:07 user nova-compute[75260]:       </nova:ports>
Nov 27 04:50:07 user nova-compute[75260]:     </nova:instance>
Nov 27 04:50:07 user nova-compute[75260]:   </metadata>
Nov 27 04:50:07 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:50:07 user nova-compute[75260]:     <system>
Nov 27 04:50:07 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:50:07 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:50:07 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:50:07 user nova-compute[75260]:       <entry name="serial">97fdc474-4f43-40fa-b33f-a7e1e380f4ec</entry>
Nov 27 04:50:07 user nova-compute[75260]:       <entry name="uuid">97fdc474-4f43-40fa-b33f-a7e1e380f4ec</entry>
Nov 27 04:50:07 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:50:07 user nova-compute[75260]:     </system>
Nov 27 04:50:07 user nova-compute[75260]:   </sysinfo>
Nov 27 04:50:07 user nova-compute[75260]:   <os>
Nov 27 04:50:07 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:50:07 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:50:07 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:50:07 user nova-compute[75260]:   </os>
Nov 27 04:50:07 user nova-compute[75260]:   <features>
Nov 27 04:50:07 user nova-compute[75260]:     <acpi/>
Nov 27 04:50:07 user nova-compute[75260]:     <apic/>
Nov 27 04:50:07 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:50:07 user nova-compute[75260]:   </features>
Nov 27 04:50:07 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:50:07 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:50:07 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:50:07 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:50:07 user nova-compute[75260]:   </clock>
Nov 27 04:50:07 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:50:07 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:50:07 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:50:07 user nova-compute[75260]:   </cpu>
Nov 27 04:50:07 user nova-compute[75260]:   <devices>
Nov 27 04:50:07 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:50:07 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:50:07 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk"/>
Nov 27 04:50:07 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:50:07 user nova-compute[75260]:     </disk>
Nov 27 04:50:07 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:50:07 user nova-compute[75260]:       <mac address="fa:16:3e:17:4b:bb"/>
Nov 27 04:50:07 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:50:07 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:50:07 user nova-compute[75260]:       <target dev="tap3ee2fcfd-34"/>
Nov 27 04:50:07 user nova-compute[75260]:     </interface>
Nov 27 04:50:07 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:50:07 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/console.log" append="off"/>
Nov 27 04:50:07 user nova-compute[75260]:     </serial>
Nov 27 04:50:07 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:50:07 user nova-compute[75260]:     <video>
Nov 27 04:50:07 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:50:07 user nova-compute[75260]:     </video>
Nov 27 04:50:07 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:50:07 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:50:07 user nova-compute[75260]:     </rng>
Nov 27 04:50:07 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:50:07 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:50:07 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:50:07 user nova-compute[75260]:     </memballoon>
Nov 27 04:50:07 user nova-compute[75260]:   </devices>
Nov 27 04:50:07 user nova-compute[75260]: </domain>
Nov 27 04:50:07 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-195716123',display_name='tempest-tempest.common.compute-instance-195716123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-195716123',id=30,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4R7s2prxxnZaQ+FL9NIcHHXMgfD6VF3HAU7eh7ww4DCPun1aOULgPRw6EAugomVlJUlPfVA9bor4qx9I5jy6H2NQrtP0cswCG82jNOmi6CoeOEhcRtUcgxt3wrB3pMsw==',key_name='tempest-keypair-1968778781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-79585enr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=97fdc474-4f43-40fa-b33f-a7e1e380f4ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG os_vif [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3eaf7558-4ff9-525e-9ae1-248d70215fa8', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ee2fcfd-34, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ee2fcfd-34, col_values=(('qos', UUID('86d0fd94-1a5e-4d98-b95e-da39ed6d3efe')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ee2fcfd-34, col_values=(('external_ids', {'iface-id': '3ee2fcfd-34f7-45ae-b191-e8459d03647b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:4b:bb', 'vm-uuid': '97fdc474-4f43-40fa-b33f-a7e1e380f4ec'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:07 user nova-compute[75260]: INFO os_vif [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34')
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No VIF found with MAC fa:16:3e:17:4b:bb, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-da48472c-01fb-4d27-80f6-1dc5e7b69fd2 req-6fa793b9-61e5-4809-816f-602f8831cd8f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Updated VIF entry in instance network info cache for port 3ee2fcfd-34f7-45ae-b191-e8459d03647b. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-da48472c-01fb-4d27-80f6-1dc5e7b69fd2 req-6fa793b9-61e5-4809-816f-602f8831cd8f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Updating instance_info_cache with network_info: [{"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:50:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-da48472c-01fb-4d27-80f6-1dc5e7b69fd2 req-6fa793b9-61e5-4809-816f-602f8831cd8f service nova] Releasing lock "refresh_cache-97fdc474-4f43-40fa-b33f-a7e1e380f4ec" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:50:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-8c86ef40-fcee-497e-a54b-c977701bb76d req-43c6f13b-eb1f-44a7-8feb-142bb2c5ff89 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:50:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8c86ef40-fcee-497e-a54b-c977701bb76d req-43c6f13b-eb1f-44a7-8feb-142bb2c5ff89 service nova] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8c86ef40-fcee-497e-a54b-c977701bb76d req-43c6f13b-eb1f-44a7-8feb-142bb2c5ff89 service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8c86ef40-fcee-497e-a54b-c977701bb76d req-43c6f13b-eb1f-44a7-8feb-142bb2c5ff89 service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-8c86ef40-fcee-497e-a54b-c977701bb76d req-43c6f13b-eb1f-44a7-8feb-142bb2c5ff89 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] No waiting events found dispatching network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:50:09 user nova-compute[75260]: WARNING nova.compute.manager [req-8c86ef40-fcee-497e-a54b-c977701bb76d req-43c6f13b-eb1f-44a7-8feb-142bb2c5ff89 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received unexpected event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b for instance with vm_state building and task_state spawning.
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.compute.manager [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:50:11 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Instance spawned successfully.
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:50:11 user nova-compute[75260]: INFO nova.compute.manager [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.compute.manager [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:50:11 user nova-compute[75260]: INFO nova.compute.manager [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Took 6.28 seconds to build instance.
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-918e18c2-ee4f-4cac-af53-80189ad65fe4 req-b1e2cbb5-458a-4674-ab51-58ebac61ab8c service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-918e18c2-ee4f-4cac-af53-80189ad65fe4 req-b1e2cbb5-458a-4674-ab51-58ebac61ab8c service nova] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-918e18c2-ee4f-4cac-af53-80189ad65fe4 req-b1e2cbb5-458a-4674-ab51-58ebac61ab8c service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-918e18c2-ee4f-4cac-af53-80189ad65fe4 req-b1e2cbb5-458a-4674-ab51-58ebac61ab8c service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-918e18c2-ee4f-4cac-af53-80189ad65fe4 req-b1e2cbb5-458a-4674-ab51-58ebac61ab8c service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] No waiting events found dispatching network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:50:11 user nova-compute[75260]: WARNING nova.compute.manager [req-918e18c2-ee4f-4cac-af53-80189ad65fe4 req-b1e2cbb5-458a-4674-ab51-58ebac61ab8c service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received unexpected event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b for instance with vm_state active and task_state None.
Nov 27 04:50:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-415e686f-b8d8-491e-ad95-4013f986032b tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.397s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:33 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:50:33 user nova-compute[75260]: INFO nova.compute.manager [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] instance snapshotting
Nov 27 04:50:33 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Beginning live snapshot process
Nov 27 04:50:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json -f qcow2 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json -f qcow2 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.167s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzjm06ei2/5c79f88165e74e668b1b6e56dfd6e6b9.delta 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzjm06ei2/5c79f88165e74e668b1b6e56dfd6e6b9.delta 1073741824" returned: 0 in 0.053s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:34 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 04:50:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:50:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:50:35 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 04:50:35 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 04:50:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzjm06ei2/5c79f88165e74e668b1b6e56dfd6e6b9.delta /opt/stack/data/nova/instances/snapshots/tmpzjm06ei2/5c79f88165e74e668b1b6e56dfd6e6b9 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzjm06ei2/5c79f88165e74e668b1b6e56dfd6e6b9.delta /opt/stack/data/nova/instances/snapshots/tmpzjm06ei2/5c79f88165e74e668b1b6e56dfd6e6b9" returned: 0 in 0.510s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Snapshot extracted, beginning image upload
Nov 27 04:50:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:38 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Snapshot image upload complete
Nov 27 04:50:38 user nova-compute[75260]: INFO nova.compute.manager [None req-d67bbe04-0cb1-4361-ab0b-b25ab7ca0bf4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Took 5.03 seconds to snapshot the instance on the hypervisor.
Nov 27 04:50:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:44 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:50:45 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:50:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:50:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:50:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:50:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:50:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updating instance_info_cache with network_info: [{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:50:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:50:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:50:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:50:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:50:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:50:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:50:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:50:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:50:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:50:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:50:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-598caf3e-6457-420b-b190-0e3e74df44a2 req-10fb0b99-083f-4669-8da2-39fd14f0dae0 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received event network-changed-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-598caf3e-6457-420b-b190-0e3e74df44a2 req-10fb0b99-083f-4669-8da2-39fd14f0dae0 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Refreshing instance network info cache due to event network-changed-d051edcd-601a-4c12-b8b0-7f1081837279. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-598caf3e-6457-420b-b190-0e3e74df44a2 req-10fb0b99-083f-4669-8da2-39fd14f0dae0 service nova] Acquiring lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-598caf3e-6457-420b-b190-0e3e74df44a2 req-10fb0b99-083f-4669-8da2-39fd14f0dae0 service nova] Acquired lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG nova.network.neutron [req-598caf3e-6457-420b-b190-0e3e74df44a2 req-10fb0b99-083f-4669-8da2-39fd14f0dae0 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Refreshing network info cache for port d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:48 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG nova.network.neutron [req-598caf3e-6457-420b-b190-0e3e74df44a2 req-10fb0b99-083f-4669-8da2-39fd14f0dae0 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Updated VIF entry in instance network info cache for port d051edcd-601a-4c12-b8b0-7f1081837279. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG nova.network.neutron [req-598caf3e-6457-420b-b190-0e3e74df44a2 req-10fb0b99-083f-4669-8da2-39fd14f0dae0 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Updating instance_info_cache with network_info: [{"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG nova.objects.instance [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lazy-loading 'flavor' on Instance uuid 60da14c7-b49d-454d-ba99-ec308c4ceb96 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-598caf3e-6457-420b-b190-0e3e74df44a2 req-10fb0b99-083f-4669-8da2-39fd14f0dae0 service nova] Releasing lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:49 user nova-compute[75260]: INFO nova.compute.manager [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Attaching volume b5355a8d-e277-4c4a-9886-139931f583cb to /dev/vdb
Nov 27 04:50:49 user nova-compute[75260]: DEBUG os_brick.utils [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0da01dc-2456-4cf1-81af-70dad5b4d7bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf78e82-ae40-4395-8d49-b3942c2cf8a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b89bf8a-2a09-43fe-ac57-8cf40e374300]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b304f79-87cb-4ab0-8971-c309c20c4867]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:50:49 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec0baa-0dfa-40d6-9798-8f9ee5df1841]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG os_brick.utils [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Updating existing volume attachment record: 900c186c-9c2e-4add-9a7f-4d7512f9a3cd {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:50:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:54 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:50:54 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7391MB free_disk=25.215015411376953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d0364679-4db1-4da8-bce8-80eea41feb13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3079fe74-317c-4325-9667-45a6754af567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:50:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:50:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:50:55 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEjetNbr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:50:56 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:50:56 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:50:56 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[954a1138-22d9-4c73-b92f-2218b2f05e52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:50:56 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c2c70-cec7-4904-902c-e385456d9f26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb] added
Nov 27 04:50:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6f88c6-3516-46ca-b7c1-8359aefd0763]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bfd548-3490-4d26-bce7-394d5b67aee1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEjetNbr {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEjetNbr" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[63345b7e-38df-4fea-95da-f1d0d8998bb3]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VEjetNbr'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f2f31-d800-4dc0-a20d-d5861d7915aa]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c34ee-30b3-42d2-bc09-9168ab8df5bd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:50:56 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:50:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:50:56 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:50:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4654f6e-8e57-409b-81b4-8fef3a3d42e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb, portal: 172.16.0.220,3260]
Nov 27 04:50:56 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb, portal: 172.16.0.220,3260] successful.
Nov 27 04:50:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2448c5-5002-403f-b005-b7cb0fc5ded7]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d017d97-3afa-42a4-a619-4c2d56a71c9d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:50:56 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:50:56 user nova-compute[75260]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)
Nov 27 04:50:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:50:56 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:50:56 user nova-compute[75260]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)
Nov 27 04:50:56 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e36c68-2933-4e8d-8cdc-eb9cb31cf17f]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:50:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEjetNbr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26566663431336138', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566663431336138', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG nova.objects.instance [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lazy-loading 'flavor' on Instance uuid 60da14c7-b49d-454d-ba99-ec308c4ceb96 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:50:57 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:50:57 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:50:57 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:50:57 user nova-compute[75260]:   <serial>b5355a8d-e277-4c4a-9886-139931f583cb</serial>
Nov 27 04:50:57 user nova-compute[75260]: </disk>
Nov 27 04:50:57 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:50:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] No VIF found with MAC fa:16:3e:53:83:c0, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:50:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fc0f1988-b2e4-4aa0-a38a-1d04ad61db75 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.519s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:00 user nova-compute[75260]: INFO nova.compute.manager [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Detaching volume b5355a8d-e277-4c4a-9886-139931f583cb
Nov 27 04:51:00 user nova-compute[75260]: INFO nova.virt.block_device [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Attempting to driver detach volume b5355a8d-e277-4c4a-9886-139931f583cb from mountpoint /dev/vdb
Nov 27 04:51:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Attempting to detach device vdb from instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:51:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:51:00 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:51:00 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:51:00 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:51:00 user nova-compute[75260]:   <serial>b5355a8d-e277-4c4a-9886-139931f583cb</serial>
Nov 27 04:51:00 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:51:00 user nova-compute[75260]: </disk>
Nov 27 04:51:00 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:51:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Successfully detached device vdb from instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 from the persistent domain config.
Nov 27 04:51:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:51:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:51:00 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:51:00 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:51:00 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:51:00 user nova-compute[75260]:   <serial>b5355a8d-e277-4c4a-9886-139931f583cb</serial>
Nov 27 04:51:00 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:51:00 user nova-compute[75260]: </disk>
Nov 27 04:51:00 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:51:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:51:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:08 user nova-compute[75260]: INFO nova.compute.manager [None req-5b2499d8-3ec6-4af0-91cf-91ed572a0dbc tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Unrescuing
Nov 27 04:51:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5b2499d8-3ec6-4af0-91cf-91ed572a0dbc tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:51:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5b2499d8-3ec6-4af0-91cf-91ed572a0dbc tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquired lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:51:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5b2499d8-3ec6-4af0-91cf-91ed572a0dbc tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5b2499d8-3ec6-4af0-91cf-91ed572a0dbc tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updating instance_info_cache with network_info: [{"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5b2499d8-3ec6-4af0-91cf-91ed572a0dbc tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Releasing lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG nova.objects.instance [None req-5b2499d8-3ec6-4af0-91cf-91ed572a0dbc tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'flavor' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-9b63da48-d80a-4bd3-9db2-aa5d3f55e7ad req-ab2a3e28-49e6-4905-b956-3b71bbe33b0a service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-unplugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b63da48-d80a-4bd3-9db2-aa5d3f55e7ad req-ab2a3e28-49e6-4905-b956-3b71bbe33b0a service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b63da48-d80a-4bd3-9db2-aa5d3f55e7ad req-ab2a3e28-49e6-4905-b956-3b71bbe33b0a service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b63da48-d80a-4bd3-9db2-aa5d3f55e7ad req-ab2a3e28-49e6-4905-b956-3b71bbe33b0a service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-9b63da48-d80a-4bd3-9db2-aa5d3f55e7ad req-ab2a3e28-49e6-4905-b956-3b71bbe33b0a service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-unplugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:51:09 user nova-compute[75260]: WARNING nova.compute.manager [req-9b63da48-d80a-4bd3-9db2-aa5d3f55e7ad req-ab2a3e28-49e6-4905-b956-3b71bbe33b0a service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-unplugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:51:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:09 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Instance destroyed successfully.
Nov 27 04:51:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-594834a1-ad3b-464a-82f3-c82a5fee4c7a req-4c0efd69-87c3-4c60-b7c5-9a265f0863ce service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received event network-changed-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-594834a1-ad3b-464a-82f3-c82a5fee4c7a req-4c0efd69-87c3-4c60-b7c5-9a265f0863ce service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Refreshing instance network info cache due to event network-changed-a99a93fb-2492-43cd-be0b-04fbcf66e165. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-594834a1-ad3b-464a-82f3-c82a5fee4c7a req-4c0efd69-87c3-4c60-b7c5-9a265f0863ce service nova] Acquiring lock "refresh_cache-3079fe74-317c-4325-9667-45a6754af567" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-594834a1-ad3b-464a-82f3-c82a5fee4c7a req-4c0efd69-87c3-4c60-b7c5-9a265f0863ce service nova] Acquired lock "refresh_cache-3079fe74-317c-4325-9667-45a6754af567" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:51:09 user nova-compute[75260]: DEBUG nova.network.neutron [req-594834a1-ad3b-464a-82f3-c82a5fee4c7a req-4c0efd69-87c3-4c60-b7c5-9a265f0863ce service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Refreshing network info cache for port a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:51:10 user nova-compute[75260]: DEBUG nova.network.neutron [req-594834a1-ad3b-464a-82f3-c82a5fee4c7a req-4c0efd69-87c3-4c60-b7c5-9a265f0863ce service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Updated VIF entry in instance network info cache for port a99a93fb-2492-43cd-be0b-04fbcf66e165. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:51:10 user nova-compute[75260]: DEBUG nova.network.neutron [req-594834a1-ad3b-464a-82f3-c82a5fee4c7a req-4c0efd69-87c3-4c60-b7c5-9a265f0863ce service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Updating instance_info_cache with network_info: [{"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:51:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-594834a1-ad3b-464a-82f3-c82a5fee4c7a req-4c0efd69-87c3-4c60-b7c5-9a265f0863ce service nova] Releasing lock "refresh_cache-3079fe74-317c-4325-9667-45a6754af567" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:51:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:51:11 user nova-compute[75260]: WARNING nova.compute.manager [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:51:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:51:11 user nova-compute[75260]: WARNING nova.compute.manager [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:51:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:51:11 user nova-compute[75260]: WARNING nova.compute.manager [req-a0038e3b-ec43-498b-94b2-dc459cfa418e req-a6de4931-9f67-4c24-acaa-6df664a171f5 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:51:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "3079fe74-317c-4325-9667-45a6754af567" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG nova.objects.instance [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'flavor' on Instance uuid 3079fe74-317c-4325-9667-45a6754af567 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "3079fe74-317c-4325-9667-45a6754af567" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:12 user nova-compute[75260]: INFO nova.compute.manager [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Attaching volume 46828540-64c6-45b5-8e98-f61c17d37a11 to /dev/vdb
Nov 27 04:51:12 user nova-compute[75260]: DEBUG os_brick.utils [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[984341fc-bc9a-441c-b7e8-f9d083401233]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de6fde7-1a9e-4fbb-9972-dc8093ffdaa9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d59ab0-176c-4a68-b715-79c5f230e8fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb67505-19c6-4a52-8167-a2a431d4d31a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:51:13 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:51:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8714fe28-817e-4320-88d1-e110dc42f46e]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG os_brick.utils [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Updating existing volume attachment record: ff09d875-a6f2-4378-a60a-37d3819692ba {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:51:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5b2499d8-3ec6-4af0-91cf-91ed572a0dbc tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:51:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LgKMSGqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:19 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:51:19 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:51:19 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[702c9f02-c37c-4094-b6b3-720e5c88f87a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:51:19 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82ac71d-d663-455a-95c1-6e1907d9225c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11] added
Nov 27 04:51:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a514ca6d-f51a-426f-a367-ff442790734e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[47239518-6de6-4f32-9af6-909e8d1886e1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LgKMSGqH {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LgKMSGqH" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff621c-4449-44c6-bb39-c163dde43d38]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LgKMSGqH'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5138c3e-e842-475b-847a-2844df206397]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4065651-0383-4295-8f52-5739fa987a10]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:19 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:19 user nova-compute[75260]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)
Nov 27 04:51:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:19 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:19 user nova-compute[75260]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)
Nov 27 04:51:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb499e8e-1f58-463b-8014-6ad904561d71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11, portal: 172.16.0.220,3260]
Nov 27 04:51:19 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11, portal: 172.16.0.220,3260] successful.
Nov 27 04:51:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13adc1b-4c25-447d-96e1-10fd00f278a5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8619e9d-cf3d-4b30-bbfa-d3d0cea6baaa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:19 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:19 user nova-compute[75260]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)
Nov 27 04:51:19 user nova-compute[75260]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)
Nov 27 04:51:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:19 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:19 user nova-compute[75260]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)
Nov 27 04:51:19 user nova-compute[75260]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)
Nov 27 04:51:19 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:51:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5814f8-87dc-4e73-83f3-755f4ecff107]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:20 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:51:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LgKMSGqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26661313466313463', 'path': '/dev/sde'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661313466313463', 'path': '/dev/sde'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG nova.objects.instance [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'flavor' on Instance uuid 3079fe74-317c-4325-9667-45a6754af567 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:51:21 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:51:21 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:51:21 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:51:21 user nova-compute[75260]:   <serial>46828540-64c6-45b5-8e98-f61c17d37a11</serial>
Nov 27 04:51:21 user nova-compute[75260]: </disk>
Nov 27 04:51:21 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:51:21 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 is timed out.
Nov 27 04:51:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Successfully detached device vdb from instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 from the live domain config.
Nov 27 04:51:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEjetNbr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:21 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[43657730-df34-4bb0-9867-035032942ff2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:51:21 user nova-compute[75260]: No targets found.
Nov 27 04:51:21 user nova-compute[75260]: iSNS:
Nov 27 04:51:21 user nova-compute[75260]: No targets found.
Nov 27 04:51:21 user nova-compute[75260]: STATIC:
Nov 27 04:51:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb
Nov 27 04:51:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:51:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:51:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9
Nov 27 04:51:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:51:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:51:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117
Nov 27 04:51:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:51:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:51:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11
Nov 27 04:51:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:51:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:51:21 user nova-compute[75260]: FIRMWARE:
Nov 27 04:51:21 user nova-compute[75260]: No targets found.
Nov 27 04:51:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:51:21 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:51:21 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] No VIF found with MAC fa:16:3e:98:56:60, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f721b688-ec9a-4ca7-ac63-afd8e5628618]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c6f02-e0ce-4e94-afb9-c326a03b06ec]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:21 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:21 user nova-compute[75260]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)
Nov 27 04:51:21 user nova-compute[75260]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)
Nov 27 04:51:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:21 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:21 user nova-compute[75260]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb (non-flash)
Nov 27 04:51:21 user nova-compute[75260]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)
Nov 27 04:51:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c2b7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eba0dd-fad8-441f-b10d-c64c9db5b72b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab812e34-7190-4627-820e-b5e8ee07095f]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b546c8-db51-4bb8-850b-b5c0d70ae539]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7734201-1e92-46f8-aa22-30694b7975a9]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-44ef719e-7635-49ee-95a0-5d4c5408b846 tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.750s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d297334a-ab0c-4944-873a-8e46794a8d59]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe3c435-e48b-49d8-a778-01650e9ded26]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb, portal: 172.16.0.220,3260]
Nov 27 04:51:21 user nova-compute[75260]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb, portal: 172.16.0.220,3260] successful.
Nov 27 04:51:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5355a8d-e277-4c4a-9886-139931f583cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b68c07-10f0-4ea4-adb7-4dcbd00cc717]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] <== disconnect_volume: return (317ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:51:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:22 user nova-compute[75260]: DEBUG nova.objects.instance [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lazy-loading 'flavor' on Instance uuid 60da14c7-b49d-454d-ba99-ec308c4ceb96 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa613ba5-4f43-4abf-a725-31c489998a65 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.708s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "3079fe74-317c-4325-9667-45a6754af567" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:23 user nova-compute[75260]: INFO nova.compute.manager [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Detaching volume 46828540-64c6-45b5-8e98-f61c17d37a11
Nov 27 04:51:23 user nova-compute[75260]: INFO nova.virt.block_device [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Attempting to driver detach volume 46828540-64c6-45b5-8e98-f61c17d37a11 from mountpoint /dev/vdb
Nov 27 04:51:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Attempting to detach device vdb from instance 3079fe74-317c-4325-9667-45a6754af567 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:51:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:51:23 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:51:23 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:51:23 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:51:23 user nova-compute[75260]:   <serial>46828540-64c6-45b5-8e98-f61c17d37a11</serial>
Nov 27 04:51:23 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:51:23 user nova-compute[75260]: </disk>
Nov 27 04:51:23 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:51:23 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully detached device vdb from instance 3079fe74-317c-4325-9667-45a6754af567 from the persistent domain config.
Nov 27 04:51:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3079fe74-317c-4325-9667-45a6754af567 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:51:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:51:23 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:51:23 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:51:23 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:51:23 user nova-compute[75260]:   <serial>46828540-64c6-45b5-8e98-f61c17d37a11</serial>
Nov 27 04:51:23 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:51:23 user nova-compute[75260]: </disk>
Nov 27 04:51:23 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:51:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3079fe74-317c-4325-9667-45a6754af567 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:51:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-c84d95d5-939d-4cda-8842-55caa08b3c4b req-e605b084-056f-4b60-9a30-0e6d9bf55477 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received event network-changed-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-c84d95d5-939d-4cda-8842-55caa08b3c4b req-e605b084-056f-4b60-9a30-0e6d9bf55477 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Refreshing instance network info cache due to event network-changed-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:51:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c84d95d5-939d-4cda-8842-55caa08b3c4b req-e605b084-056f-4b60-9a30-0e6d9bf55477 service nova] Acquiring lock "refresh_cache-06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:51:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c84d95d5-939d-4cda-8842-55caa08b3c4b req-e605b084-056f-4b60-9a30-0e6d9bf55477 service nova] Acquired lock "refresh_cache-06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:51:29 user nova-compute[75260]: DEBUG nova.network.neutron [req-c84d95d5-939d-4cda-8842-55caa08b3c4b req-e605b084-056f-4b60-9a30-0e6d9bf55477 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Refreshing network info cache for port b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:51:30 user nova-compute[75260]: DEBUG nova.network.neutron [req-c84d95d5-939d-4cda-8842-55caa08b3c4b req-e605b084-056f-4b60-9a30-0e6d9bf55477 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Updated VIF entry in instance network info cache for port b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:51:30 user nova-compute[75260]: DEBUG nova.network.neutron [req-c84d95d5-939d-4cda-8842-55caa08b3c4b req-e605b084-056f-4b60-9a30-0e6d9bf55477 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Updating instance_info_cache with network_info: [{"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:51:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c84d95d5-939d-4cda-8842-55caa08b3c4b req-e605b084-056f-4b60-9a30-0e6d9bf55477 service nova] Releasing lock "refresh_cache-06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:51:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:32 user nova-compute[75260]: INFO nova.compute.manager [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Attaching volume e2d7b61f-3809-4378-acc2-88928a876a9b to /dev/vdb
Nov 27 04:51:32 user nova-compute[75260]: DEBUG os_brick.utils [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce921d02-aff2-4ac0-8f01-be707aef046a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1c0e3b-a716-4fdf-88c4-0db5d81efad5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46eba51-086b-4135-98e9-cc925f5caa5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b337092-fc81-4b10-8946-5c9f8f2a09a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:51:32 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:51:32 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9ab478-a71f-487d-94a0-d5fc86f54528]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG os_brick.utils [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:32 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Updating existing volume attachment record: 0fc53152-c60b-4f72-a05a-3686211c6e14 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:51:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEsmtdGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:38 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:51:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:51:38 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:51:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:51:38 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:51:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3af283f-6349-438f-937c-68c26f641cdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:51:38 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cdee86-7365-4c61-9d34-b2dbb1bf6959]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b] added
Nov 27 04:51:38 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eaae5c-1a96-42c3-9e94-f88e0674a7ff]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef8f624-5fe1-4373-a357-a2dc61933436]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wEsmtdGf {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wEsmtdGf" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f435095b-e4a0-462b-a1f0-d5bf1139bf01]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wEsmtdGf'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3484abf-0462-4cf0-891b-553b1b8e0074]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f7c423-5b4b-487f-a0b6-33543f22ffd8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f255590c-a840-4361-877e-70f63d5c8121]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b, portal: 172.16.0.220,3260]
Nov 27 04:51:39 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b, portal: 172.16.0.220,3260] successful.
Nov 27 04:51:39 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2e5128-479e-4a0b-b493-8dab5ff6a867]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[069f7b9b-7546-41cf-9ab8-c91f88923347]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:39 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)
Nov 27 04:51:39 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:39 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1c61bf-cf5b-48c7-a18f-700f9f2cbef8]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:51:39 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEsmtdGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23831393838373134', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831393838373134', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:51:40 user nova-compute[75260]: INFO nova.compute.claims [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Claim successful on node user
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:51:40 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:51:40 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:51:40 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:51:40 user nova-compute[75260]:   <serial>e2d7b61f-3809-4378-acc2-88928a876a9b</serial>
Nov 27 04:51:40 user nova-compute[75260]: </disk>
Nov 27 04:51:40 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No VIF found with MAC fa:16:3e:d2:2e:2b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:51:40 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2133c0f0-3d10-4853-a71a-2d19cbff1775 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.213s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:40 user nova-compute[75260]: DEBUG nova.policy [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05cdf3b00bfe4f728e7fa4e17eba3c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eada319615449deb2152f59ba3d3e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:51:40 user nova-compute[75260]: INFO nova.virt.block_device [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Booting with blank volume at /dev/vda
Nov 27 04:51:41 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Successfully created port: de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:51:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Successfully updated port: de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquired lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG nova.compute.manager [req-d84269eb-f300-4ec1-b4c8-3b17b4dee05f req-a86a8827-db7a-468b-8488-07b469646246 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-changed-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG nova.compute.manager [req-d84269eb-f300-4ec1-b4c8-3b17b4dee05f req-a86a8827-db7a-468b-8488-07b469646246 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Refreshing instance network info cache due to event network-changed-de4a339f-5096-4327-8a9f-16433c75a112. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d84269eb-f300-4ec1-b4c8-3b17b4dee05f req-a86a8827-db7a-468b-8488-07b469646246 service nova] Acquiring lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG nova.network.neutron [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updating instance_info_cache with network_info: [{"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Releasing lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Instance network_info: |[{"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d84269eb-f300-4ec1-b4c8-3b17b4dee05f req-a86a8827-db7a-468b-8488-07b469646246 service nova] Acquired lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG nova.network.neutron [req-d84269eb-f300-4ec1-b4c8-3b17b4dee05f req-a86a8827-db7a-468b-8488-07b469646246 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Refreshing network info cache for port de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG nova.network.neutron [req-d84269eb-f300-4ec1-b4c8-3b17b4dee05f req-a86a8827-db7a-468b-8488-07b469646246 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updated VIF entry in instance network info cache for port de4a339f-5096-4327-8a9f-16433c75a112. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG nova.network.neutron [req-d84269eb-f300-4ec1-b4c8-3b17b4dee05f req-a86a8827-db7a-468b-8488-07b469646246 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updating instance_info_cache with network_info: [{"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:51:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d84269eb-f300-4ec1-b4c8-3b17b4dee05f req-a86a8827-db7a-468b-8488-07b469646246 service nova] Releasing lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:51:43 user nova-compute[75260]: INFO nova.compute.manager [None req-440d1e8c-36b9-4f8a-afba-0ba6fdb5d4ee tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Unrescuing
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-440d1e8c-36b9-4f8a-afba-0ba6fdb5d4ee tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-440d1e8c-36b9-4f8a-afba-0ba6fdb5d4ee tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquired lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG nova.network.neutron [None req-440d1e8c-36b9-4f8a-afba-0ba6fdb5d4ee tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:51:43 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3079fe74-317c-4325-9667-45a6754af567 is timed out.
Nov 27 04:51:43 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully detached device vdb from instance 3079fe74-317c-4325-9667-45a6754af567 from the live domain config.
Nov 27 04:51:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LgKMSGqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:43 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cdaaf4-6155-4cda-ba7e-c4127c33d5d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:51:43 user nova-compute[75260]: No targets found.
Nov 27 04:51:43 user nova-compute[75260]: iSNS:
Nov 27 04:51:43 user nova-compute[75260]: No targets found.
Nov 27 04:51:43 user nova-compute[75260]: STATIC:
Nov 27 04:51:43 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9
Nov 27 04:51:43 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:51:43 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:51:43 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b
Nov 27 04:51:43 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:51:43 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:51:43 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117
Nov 27 04:51:43 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:51:43 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:51:43 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11
Nov 27 04:51:43 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:51:43 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:51:43 user nova-compute[75260]: FIRMWARE:
Nov 27 04:51:43 user nova-compute[75260]: No targets found.
Nov 27 04:51:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:51:43 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:51:43 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafb0ddb-7c34-48dc-9148-e1c8e8b874bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5381bc08-540a-40b0-b184-dfd4fa8fdcd4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:43 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:43 user nova-compute[75260]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)
Nov 27 04:51:43 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:43 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:43 user nova-compute[75260]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 (non-flash)
Nov 27 04:51:43 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c2b6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11'): ({'sde'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Removing single pathed devices sde {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f85a42-372c-419c-a72b-ab79748134bf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1769b13-78e5-42b3-8c9e-7634998d4025]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Flushing IO for device /dev/sde {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[216a6577-e64f-4162-a1ea-59e95f43ad77]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f6a823-f01e-470c-8568-f67417163153]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dfe588-2468-4dd9-b443-cbf8faa6b61f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG nova.objects.instance [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad37efde-559a-4947-b177-b0d645ccb088]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11, portal: 172.16.0.220,3260]
Nov 27 04:51:43 user nova-compute[75260]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11, portal: 172.16.0.220,3260] successful.
Nov 27 04:51:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46828540-64c6-45b5-8e98-f61c17d37a11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0a96c5-c7d8-4e47-941b-e1f6fe659771]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] <== disconnect_volume: return (342ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-440d1e8c-36b9-4f8a-afba-0ba6fdb5d4ee tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updating instance_info_cache with network_info: [{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-440d1e8c-36b9-4f8a-afba-0ba6fdb5d4ee tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Releasing lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG nova.objects.instance [None req-440d1e8c-36b9-4f8a-afba-0ba6fdb5d4ee tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'flavor' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:44 user nova-compute[75260]: INFO nova.compute.manager [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Attaching volume e8da4aff-7aad-4990-a945-148ceaf2ce4b to /dev/vdc
Nov 27 04:51:44 user nova-compute[75260]: DEBUG os_brick.utils [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a18ea6c-ec75-425c-a7f8-ff482796600a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce32aa1-57ef-412a-a74c-9cdcbe819523]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b51c4f2-d057-46d2-a902-1f3cc797c0f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb37dfaa-6ad4-4c51-a0e4-8fc7fbc15bd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:51:44 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d44b1c-83a6-49e9-bc81-fd8714844f91]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG os_brick.utils [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Updating existing volume attachment record: 28f2a6fc-4530-4b14-a2f0-86c7457f009b {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-c32d4db4-fc01-49e5-b126-5a0cec4e2fe9 req-1e16319e-13d3-4fd8-be95-d8711987e5c9 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-unplugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c32d4db4-fc01-49e5-b126-5a0cec4e2fe9 req-1e16319e-13d3-4fd8-be95-d8711987e5c9 service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c32d4db4-fc01-49e5-b126-5a0cec4e2fe9 req-1e16319e-13d3-4fd8-be95-d8711987e5c9 service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c32d4db4-fc01-49e5-b126-5a0cec4e2fe9 req-1e16319e-13d3-4fd8-be95-d8711987e5c9 service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-c32d4db4-fc01-49e5-b126-5a0cec4e2fe9 req-1e16319e-13d3-4fd8-be95-d8711987e5c9 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-unplugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:51:44 user nova-compute[75260]: WARNING nova.compute.manager [req-c32d4db4-fc01-49e5-b126-5a0cec4e2fe9 req-1e16319e-13d3-4fd8-be95-d8711987e5c9 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-unplugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:51:44 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'flavor' on Instance uuid 3079fe74-317c-4325-9667-45a6754af567 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e567427a-8087-4b6b-8856-54ba6187073e tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Instance destroyed successfully.
Nov 27 04:51:45 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:51:45 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG os_brick.utils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6863614e-9c29-4895-93d0-9b97dfdea034]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5822ae0e-8a87-4371-9435-34f90578b485]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a28f264-eb47-475a-88da-fd4b17af0835]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6744d48a-c34c-4a20-861d-ef718d58941c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:51:46 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec5a0a6-1db1-4dfd-8210-b825ee37da8c]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG os_brick.utils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updating existing volume attachment record: af591662-d1cc-474b-9875-84a7c5ef8220 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:51:46 user nova-compute[75260]: WARNING nova.compute.manager [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:51:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-changed-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Refreshing instance network info cache due to event network-changed-08fcec14-f146-4deb-861b-02af609bfd4e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Acquiring lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Acquired lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG nova.network.neutron [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Refreshing network info cache for port 08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:51:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.network.neutron [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updated VIF entry in instance network info cache for port 08fcec14-f146-4deb-861b-02af609bfd4e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.network.neutron [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updating instance_info_cache with network_info: [{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Releasing lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-changed-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Refreshing instance network info cache due to event network-changed-08fcec14-f146-4deb-861b-02af609bfd4e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Acquiring lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Acquired lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.network.neutron [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Refreshing network info cache for port 08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updating instance_info_cache with network_info: [{"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.network.neutron [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updated VIF entry in instance network info cache for port 08fcec14-f146-4deb-861b-02af609bfd4e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.network.neutron [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updating instance_info_cache with network_info: [{"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Releasing lock "refresh_cache-57ee8ff0-df13-4f15-96a0-c324b10dd9a7" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:51:47 user nova-compute[75260]: WARNING nova.compute.manager [req-8bfa1f88-5e67-4197-9f2d-601db2a78be9 req-a46deae7-08d9-49fb-a875-a2019362b6fe service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:51:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:51:48 user nova-compute[75260]: DEBUG nova.compute.manager [None req-440d1e8c-36b9-4f8a-afba-0ba6fdb5d4ee tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:51:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-84aaaf87-83a7-48e8-936b-461cd7f5eea2 req-444c6f67-0a23-4bc8-b444-20f3a84db1b8 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84aaaf87-83a7-48e8-936b-461cd7f5eea2 req-444c6f67-0a23-4bc8-b444-20f3a84db1b8 service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84aaaf87-83a7-48e8-936b-461cd7f5eea2 req-444c6f67-0a23-4bc8-b444-20f3a84db1b8 service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-84aaaf87-83a7-48e8-936b-461cd7f5eea2 req-444c6f67-0a23-4bc8-b444-20f3a84db1b8 service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-84aaaf87-83a7-48e8-936b-461cd7f5eea2 req-444c6f67-0a23-4bc8-b444-20f3a84db1b8 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:51:48 user nova-compute[75260]: WARNING nova.compute.manager [req-84aaaf87-83a7-48e8-936b-461cd7f5eea2 req-444c6f67-0a23-4bc8-b444-20f3a84db1b8 service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state active and task_state None.
Nov 27 04:51:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:51:49 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKDsNFzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:50 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:51:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:51:50 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:51:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:51:50 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e091d7-ec66-4283-ac3e-93fe2373b92c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:51:50 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[49348330-215b-4a6c-9255-29ceb21343c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b] added
Nov 27 04:51:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8ef7a2-54ac-406c-8ce6-8ab757dd9fc0]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a950e4-9ac3-43f3-ad07-b3b70f871d11]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKDsNFzx {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKDsNFzx" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cb50c4-7560-4bd6-bf4a-7c148a772d6d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LKDsNFzx'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d32bf91-8bab-4b32-bf91-247636c8dd7b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[880d51e6-7cbf-4f06-b665-5f0c2da3580e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:51 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:51 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:51 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:51 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74a07ec-f005-4129-b7ef-788f016566da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b, portal: 172.16.0.220,3260]
Nov 27 04:51:51 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b, portal: 172.16.0.220,3260] successful.
Nov 27 04:51:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[63234e9e-97eb-420a-a3dc-0b3f3a2e3c5a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb9972a-266b-4fc7-958b-f121654ae47a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:51 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:51 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:51 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:51:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:51 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:51 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:51 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:51:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[da118350-d0d4-4851-86b2-b9bd04d821f3]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKDsNFzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26161666438376535', 'path': '/dev/sde'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161666438376535', 'path': '/dev/sde'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG nova.objects.instance [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:51:52 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:51:52 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:51:52 user nova-compute[75260]:   <target dev="vdc" bus="virtio"/>
Nov 27 04:51:52 user nova-compute[75260]:   <serial>e8da4aff-7aad-4990-a945-148ceaf2ce4b</serial>
Nov 27 04:51:52 user nova-compute[75260]: </disk>
Nov 27 04:51:52 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] No VIF found with MAC fa:16:3e:d2:2e:2b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4181f722-a863-42e2-87c0-3dddf45a64d3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.885s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:51:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Creating image(s)
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Ensure instance console log exists: /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Start _get_guest_xml network_info=[{"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'af591662-d1cc-474b-9875-84a7c5ef8220', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqgnjUwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7c75f6e-668d-49ec-8bc3-b003b839d205', 'attached_at': '', 'detached_at': '', 'volume_id': '01add167-eeb1-4fe2-81c7-32f3d08563ad', 'serial': '01add167-eeb1-4fe2-81c7-32f3d08563ad'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:51:53 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:51:53 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqgnjUwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:53 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:51:53 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:51:53 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf06340-dcb6-470c-8528-98255d74c432]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:51:53 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aba8db-aa40-46d9-8723-ffcf174cf7d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad] added
Nov 27 04:51:53 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3ef15d-83af-48cf-add7-902e15a3d822]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1321d2-3d41-4799-9735-723d7170a738]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xqgnjUwF {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xqgnjUwF" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae3f457-e890-4b48-a1f9-6ef9c2719d0e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xqgnjUwF'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[01093156-7442-40c1-9bb4-f9752ec22356]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f279d9-57f3-4549-9e5b-808bc84909da]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:51:53 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:51:53 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdccca2-7a7e-4c96-bea0-7c8cc6044bd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad, portal: 172.16.0.220,3260]
Nov 27 04:51:53 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad, portal: 172.16.0.220,3260] successful.
Nov 27 04:51:53 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68bef77-2b8b-45ab-84eb-10232f8653e5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc77be1-54d3-4870-afbc-61131d39ffd2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:51:53 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:51:53 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:51:53 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf32cbab-24bf-4be5-8f1c-6e9cdfe85d64]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:53 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:54 user nova-compute[75260]: INFO nova.compute.manager [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Detaching volume e2d7b61f-3809-4378-acc2-88928a876a9b
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:54 user nova-compute[75260]: INFO nova.virt.block_device [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Attempting to driver detach volume e2d7b61f-3809-4378-acc2-88928a876a9b from mountpoint /dev/vdb
Nov 27 04:51:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Attempting to detach device vdb from instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:51:54 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:51:54 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:51:54 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:51:54 user nova-compute[75260]:   <serial>e2d7b61f-3809-4378-acc2-88928a876a9b</serial>
Nov 27 04:51:54 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:51:54 user nova-compute[75260]: </disk>
Nov 27 04:51:54 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:51:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully detached device vdb from instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 from the persistent domain config.
Nov 27 04:51:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:51:54 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:51:54 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:51:54 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:51:54 user nova-compute[75260]:   <serial>e2d7b61f-3809-4378-acc2-88928a876a9b</serial>
Nov 27 04:51:54 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:51:54 user nova-compute[75260]: </disk>
Nov 27 04:51:54 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:51:54 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqgnjUwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23062316439346165', 'path': '/dev/sdf'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062316439346165', 'path': '/dev/sdf'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-665818185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-665818185',id=31,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-50cm5jfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:51:41Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=e7c75f6e-668d-49ec-8bc3-b003b839d205,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:34:6c,bridge_name='br-int',has_traffic_filtering=True,id=de4a339f-5096-4327-8a9f-16433c75a112,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a339f-50') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'pci_devices' on Instance uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:51:55 user nova-compute[75260]:   <uuid>e7c75f6e-668d-49ec-8bc3-b003b839d205</uuid>
Nov 27 04:51:55 user nova-compute[75260]:   <name>instance-0000001f</name>
Nov 27 04:51:55 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:51:55 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:51:55 user nova-compute[75260]:   <metadata>
Nov 27 04:51:55 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:51:55 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:51:55 user nova-compute[75260]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-665818185</nova:name>
Nov 27 04:51:55 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:51:53</nova:creationTime>
Nov 27 04:51:55 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:51:55 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:51:55 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:51:55 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:51:55 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:51:55 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:51:55 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:51:55 user nova-compute[75260]:       <nova:owner>
Nov 27 04:51:55 user nova-compute[75260]:         <nova:user uuid="05cdf3b00bfe4f728e7fa4e17eba3c4e">tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member</nova:user>
Nov 27 04:51:55 user nova-compute[75260]:         <nova:project uuid="7eada319615449deb2152f59ba3d3e6d">tempest-ServerBootFromVolumeStableRescueTest-293744143</nova:project>
Nov 27 04:51:55 user nova-compute[75260]:       </nova:owner>
Nov 27 04:51:55 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:51:55 user nova-compute[75260]:       <nova:ports>
Nov 27 04:51:55 user nova-compute[75260]:         <nova:port uuid="de4a339f-5096-4327-8a9f-16433c75a112">
Nov 27 04:51:55 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 04:51:55 user nova-compute[75260]:         </nova:port>
Nov 27 04:51:55 user nova-compute[75260]:       </nova:ports>
Nov 27 04:51:55 user nova-compute[75260]:     </nova:instance>
Nov 27 04:51:55 user nova-compute[75260]:   </metadata>
Nov 27 04:51:55 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:51:55 user nova-compute[75260]:     <system>
Nov 27 04:51:55 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:51:55 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:51:55 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:51:55 user nova-compute[75260]:       <entry name="serial">e7c75f6e-668d-49ec-8bc3-b003b839d205</entry>
Nov 27 04:51:55 user nova-compute[75260]:       <entry name="uuid">e7c75f6e-668d-49ec-8bc3-b003b839d205</entry>
Nov 27 04:51:55 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:51:55 user nova-compute[75260]:     </system>
Nov 27 04:51:55 user nova-compute[75260]:   </sysinfo>
Nov 27 04:51:55 user nova-compute[75260]:   <os>
Nov 27 04:51:55 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:51:55 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:51:55 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:51:55 user nova-compute[75260]:   </os>
Nov 27 04:51:55 user nova-compute[75260]:   <features>
Nov 27 04:51:55 user nova-compute[75260]:     <acpi/>
Nov 27 04:51:55 user nova-compute[75260]:     <apic/>
Nov 27 04:51:55 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:51:55 user nova-compute[75260]:   </features>
Nov 27 04:51:55 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:51:55 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:51:55 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:51:55 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:51:55 user nova-compute[75260]:   </clock>
Nov 27 04:51:55 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:51:55 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:51:55 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:51:55 user nova-compute[75260]:   </cpu>
Nov 27 04:51:55 user nova-compute[75260]:   <devices>
Nov 27 04:51:55 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:51:55 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:51:55 user nova-compute[75260]:       <source dev="/dev/sdf"/>
Nov 27 04:51:55 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:51:55 user nova-compute[75260]:       <serial>01add167-eeb1-4fe2-81c7-32f3d08563ad</serial>
Nov 27 04:51:55 user nova-compute[75260]:     </disk>
Nov 27 04:51:55 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:51:55 user nova-compute[75260]:       <mac address="fa:16:3e:54:34:6c"/>
Nov 27 04:51:55 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:51:55 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:51:55 user nova-compute[75260]:       <target dev="tapde4a339f-50"/>
Nov 27 04:51:55 user nova-compute[75260]:     </interface>
Nov 27 04:51:55 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:51:55 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/console.log" append="off"/>
Nov 27 04:51:55 user nova-compute[75260]:     </serial>
Nov 27 04:51:55 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:51:55 user nova-compute[75260]:     <video>
Nov 27 04:51:55 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:51:55 user nova-compute[75260]:     </video>
Nov 27 04:51:55 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:51:55 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:51:55 user nova-compute[75260]:     </rng>
Nov 27 04:51:55 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:51:55 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:51:55 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:51:55 user nova-compute[75260]:     </memballoon>
Nov 27 04:51:55 user nova-compute[75260]:   </devices>
Nov 27 04:51:55 user nova-compute[75260]: </domain>
Nov 27 04:51:55 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-665818185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-665818185',id=31,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-50cm5jfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:51:41Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=e7c75f6e-668d-49ec-8bc3-b003b839d205,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:34:6c,bridge_name='br-int',has_traffic_filtering=True,id=de4a339f-5096-4327-8a9f-16433c75a112,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a339f-50') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG os_vif [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:34:6c,bridge_name='br-int',has_traffic_filtering=True,id=de4a339f-5096-4327-8a9f-16433c75a112,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a339f-50') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75b759dc-1857-5cf2-b7bd-3e1b7b163d90', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde4a339f-50, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde4a339f-50, col_values=(('qos', UUID('7f91b827-e8ca-4456-86d8-528466344cb8')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde4a339f-50, col_values=(('external_ids', {'iface-id': 'de4a339f-5096-4327-8a9f-16433c75a112', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:34:6c', 'vm-uuid': 'e7c75f6e-668d-49ec-8bc3-b003b839d205'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:55 user nova-compute[75260]: INFO os_vif [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:34:6c,bridge_name='br-int',has_traffic_filtering=True,id=de4a339f-5096-4327-8a9f-16433c75a112,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a339f-50')
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No VIF found with MAC fa:16:3e:54:34:6c, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.compute.manager [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:51:55 user nova-compute[75260]: INFO nova.compute.manager [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] instance snapshotting
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Beginning live snapshot process
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json -f qcow2 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-cc260273-62ec-4e2a-9c86-e6ab89c1f860 req-8ad5bffd-75e6-4ee3-b398-c30f8286c9f9 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-changed-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-cc260273-62ec-4e2a-9c86-e6ab89c1f860 req-8ad5bffd-75e6-4ee3-b398-c30f8286c9f9 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Refreshing instance network info cache due to event network-changed-3ee2fcfd-34f7-45ae-b191-e8459d03647b. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cc260273-62ec-4e2a-9c86-e6ab89c1f860 req-8ad5bffd-75e6-4ee3-b398-c30f8286c9f9 service nova] Acquiring lock "refresh_cache-97fdc474-4f43-40fa-b33f-a7e1e380f4ec" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cc260273-62ec-4e2a-9c86-e6ab89c1f860 req-8ad5bffd-75e6-4ee3-b398-c30f8286c9f9 service nova] Acquired lock "refresh_cache-97fdc474-4f43-40fa-b33f-a7e1e380f4ec" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG nova.network.neutron [req-cc260273-62ec-4e2a-9c86-e6ab89c1f860 req-8ad5bffd-75e6-4ee3-b398-c30f8286c9f9 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Refreshing network info cache for port 3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json -f qcow2 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:51:58 user nova-compute[75260]: WARNING nova.compute.manager [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state building and task_state spawning.
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:51:58 user nova-compute[75260]: WARNING nova.compute.manager [req-db45296c-7f56-4158-8df0-a7d8dcb402fe req-c6fd8b97-943a-4db0-a4c6-2ebfe388a8f9 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state building and task_state spawning.
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json -f qcow2" returned: 0 in 2.783s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:58 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:51:58 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7560MB free_disk=25.20444107055664GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Instance spawned successfully.
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.objects.instance [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'flavor' on Instance uuid 97fdc474-4f43-40fa-b33f-a7e1e380f4ec {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:58 user nova-compute[75260]: INFO nova.compute.manager [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 27 04:51:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpby2h0ou0/70dff21abecf43f6808180a6a2ea340e.delta 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpby2h0ou0/70dff21abecf43f6808180a6a2ea340e.delta 1073741824" returned: 0 in 0.084s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:59 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:51:59 user nova-compute[75260]: INFO nova.compute.manager [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Attaching volume d0e039b7-5c3a-4ac7-8cbf-706b552a0168 to /dev/vdb
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d0364679-4db1-4da8-bce8-80eea41feb13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3079fe74-317c-4325-9667-45a6754af567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:51:59 user nova-compute[75260]: INFO nova.compute.manager [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Took 18.91 seconds to build instance.
Nov 27 04:51:59 user nova-compute[75260]: DEBUG os_brick.utils [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2cf5ad92-9c69-43b4-b48d-92bb841af639 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.007s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[99762d43-7220-4db9-bc02-6432a0351d92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee362b6b-eb69-4786-8cc6-ef0a3861a9e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[63906a68-615c-4628-aff5-072ce2b2f19f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[99390220-12eb-4012-ae70-165e223d2742]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-cc260273-62ec-4e2a-9c86-e6ab89c1f860 req-8ad5bffd-75e6-4ee3-b398-c30f8286c9f9 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Updated VIF entry in instance network info cache for port 3ee2fcfd-34f7-45ae-b191-e8459d03647b. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-cc260273-62ec-4e2a-9c86-e6ab89c1f860 req-8ad5bffd-75e6-4ee3-b398-c30f8286c9f9 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Updating instance_info_cache with network_info: [{"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cc260273-62ec-4e2a-9c86-e6ab89c1f860 req-8ad5bffd-75e6-4ee3-b398-c30f8286c9f9 service nova] Releasing lock "refresh_cache-97fdc474-4f43-40fa-b33f-a7e1e380f4ec" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:51:59 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26da246-f5db-46dd-98cc-666e15ba5291]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG os_brick.utils [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Updating existing volume attachment record: cb62551e-a99a-4a6b-b55a-1cc0316bede0 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:51:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] COPY block job progress, current cursor: 0 final cursor: 75628544 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:52:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] COPY block job progress, current cursor: 75628544 final cursor: 75628544 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:52:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 04:52:00 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 04:52:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpby2h0ou0/70dff21abecf43f6808180a6a2ea340e.delta /opt/stack/data/nova/instances/snapshots/tmpby2h0ou0/70dff21abecf43f6808180a6a2ea340e {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpby2h0ou0/70dff21abecf43f6808180a6a2ea340e.delta /opt/stack/data/nova/instances/snapshots/tmpby2h0ou0/70dff21abecf43f6808180a6a2ea340e" returned: 0 in 0.525s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Snapshot extracted, beginning image upload
Nov 27 04:52:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:03 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Snapshot image upload complete
Nov 27 04:52:03 user nova-compute[75260]: INFO nova.compute.manager [None req-94de395a-4570-4776-8268-cc869c1ffb14 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Took 7.96 seconds to snapshot the instance on the hypervisor.
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:52:05 user nova-compute[75260]: INFO nova.compute.claims [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Claim successful on node user
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:52:05 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.policy [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82e2cb36c4904d189ad7b29f933f480e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c37c5e030f48b293656f786ea1aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:52:05 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Creating image(s)
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "/opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "/opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "/opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "b7d56e9b7f9717367efcbd24f716c4219cbbe397" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "b7d56e9b7f9717367efcbd24f716c4219cbbe397" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esNnabOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:52:05 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:52:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:52:05 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:52:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:52:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:52:05 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:52:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1b6521-5472-424c-8108-5c6b1a161b13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:52:06 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[138380ac-97ae-4f34-84c7-c40e86088907]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168] added
Nov 27 04:52:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397.part --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[485fcadd-5865-4a31-8021-4f5c78987261]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Successfully created port: abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57c32f0-7a70-4d08-8eae-477a92e48a9d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v esNnabOH {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v esNnabOH" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa9dcec-df03-41fd-a390-187b96e51585]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'esNnabOH'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3963c8fa-1b70-41a1-a2fd-b8c1d2666970]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG nova.virt.images [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] c8b18da7-d3b4-486d-bfd8-cfc6c2df8a36 was qcow2, converting to raw {{(pid=75260) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397.part /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397.converted {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7e64da-5062-488f-af0d-164f355e2505]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:07 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:07 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --login" returned: 0 in 0.173s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8989db-11d0-4036-92ed-5df36a3ce366]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260]
Nov 27 04:52:07 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260] successful.
Nov 27 04:52:07 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3f2bcd-bea5-4e37-9cdb-5cb751564305]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d9ba19-a7f5-4564-b63f-89f52cdf958c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:52:07 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:07 user nova-compute[75260]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:52:07 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.602s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397.part /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397.converted" returned: 0 in 0.296s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397.converted --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[17666ed5-6306-41ff-9319-ffd4a5b62851]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esNnabOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397.converted --force-share --output=json" returned: 0 in 0.238s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "b7d56e9b7f9717367efcbd24f716c4219cbbe397" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.951s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397 --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "b7d56e9b7f9717367efcbd24f716c4219cbbe397" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "b7d56e9b7f9717367efcbd24f716c4219cbbe397" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Successfully updated port: abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.compute.manager [req-4d6268a7-a0ea-490e-b025-3372c0c1e0e0 req-fcb803a5-746e-4a14-8b3e-39bd80936499 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received event network-changed-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.compute.manager [req-4d6268a7-a0ea-490e-b025-3372c0c1e0e0 req-fcb803a5-746e-4a14-8b3e-39bd80936499 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Refreshing instance network info cache due to event network-changed-abea12ed-6f73-4322-a892-6c29383eaece. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4d6268a7-a0ea-490e-b025-3372c0c1e0e0 req-fcb803a5-746e-4a14-8b3e-39bd80936499 service nova] Acquiring lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4d6268a7-a0ea-490e-b025-3372c0c1e0e0 req-fcb803a5-746e-4a14-8b3e-39bd80936499 service nova] Acquired lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.neutron [req-4d6268a7-a0ea-490e-b025-3372c0c1e0e0 req-fcb803a5-746e-4a14-8b3e-39bd80936499 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Refreshing network info cache for port abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.neutron [req-4d6268a7-a0ea-490e-b025-3372c0c1e0e0 req-fcb803a5-746e-4a14-8b3e-39bd80936499 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397 --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397,backing_fmt=raw /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397,backing_fmt=raw /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk 1073741824" returned: 0 in 0.056s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "b7d56e9b7f9717367efcbd24f716c4219cbbe397" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.neutron [req-4d6268a7-a0ea-490e-b025-3372c0c1e0e0 req-fcb803a5-746e-4a14-8b3e-39bd80936499 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4d6268a7-a0ea-490e-b025-3372c0c1e0e0 req-fcb803a5-746e-4a14-8b3e-39bd80936499 service nova] Releasing lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquired lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397 --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Ensure instance console log exists: /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Updating instance_info_cache with network_info: [{"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Releasing lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Instance network_info: |[{"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Start _get_guest_xml network_info=[{"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='96ace9a693cf1aa830f6c5189ff1def1',container_format='bare',created_at=2023-11-27T04:51:55Z,direct_url=<?>,disk_format='qcow2',id=c8b18da7-d3b4-486d-bfd8-cfc6c2df8a36,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-151967671',owner='06c37c5e030f48b293656f786ea1aeef',properties=ImageMetaProps,protected=<?>,size=52428800,status='active',tags=<?>,updated_at=2023-11-27T04:52:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c8b18da7-d3b4-486d-bfd8-cfc6c2df8a36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:52:08 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:52:08 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:52:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.742s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== connect_volume: return (2743ms) {'type': 'block', 'scsi_wwn': '23662656338313662', 'path': '/dev/sdg'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662656338313662', 'path': '/dev/sdg'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='96ace9a693cf1aa830f6c5189ff1def1',container_format='bare',created_at=2023-11-27T04:51:55Z,direct_url=<?>,disk_format='qcow2',id=c8b18da7-d3b4-486d-bfd8-cfc6c2df8a36,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-151967671',owner='06c37c5e030f48b293656f786ea1aeef',properties=ImageMetaProps,protected=<?>,size=52428800,status='active',tags=<?>,updated_at=2023-11-27T04:52:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1561718750',display_name='tempest-TestStampPattern-server-1561718750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1561718750',id=32,image_ref='c8b18da7-d3b4-486d-bfd8-cfc6c2df8a36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEm4ycTHTc6irbNWzi82l/iS13TDWE7Tbj1uK6oYdFuMWX34xe8U7Ts31a/zWSA7B9JpTfl9arNxPKlrPcez9SIQg8qSky+ZGAnVKHoKPTF0lkUsqytbC2eApCQB/fW4Dw==',key_name='tempest-TestStampPattern-81536007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06c37c5e030f48b293656f786ea1aeef',ramdisk_id='',reservation_id='r-imdr0hma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60da14c7-b49d-454d-ba99-ec308c4ceb96',image_min_disk='1',image_min_ram='0',image_owner_id='06c37c5e030f48b293656f786ea1aeef',image_owner_project_name='tempest-TestStampPattern-785030743',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-785030743-project-member',image_user_id='82e2cb36c4904d189ad7b29f933f480e',network_allocated='True',owner_project_name='tempest-TestStampPattern-785030743',owner_user_name='tempest-TestStampPattern-785030743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:52:06Z,user_data=None,user_id='82e2cb36c4904d189ad7b29f933f480e',uuid=f29594ea-2a52-48ac-acfd-66e16dea9dfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converting VIF {"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:84:60,bridge_name='br-int',has_traffic_filtering=True,id=abea12ed-6f73-4322-a892-6c29383eaece,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabea12ed-6f') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lazy-loading 'pci_devices' on Instance uuid f29594ea-2a52-48ac-acfd-66e16dea9dfd {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'flavor' on Instance uuid 97fdc474-4f43-40fa-b33f-a7e1e380f4ec {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:52:08 user nova-compute[75260]:   <uuid>f29594ea-2a52-48ac-acfd-66e16dea9dfd</uuid>
Nov 27 04:52:08 user nova-compute[75260]:   <name>instance-00000020</name>
Nov 27 04:52:08 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:52:08 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:52:08 user nova-compute[75260]:   <metadata>
Nov 27 04:52:08 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:52:08 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:52:08 user nova-compute[75260]:       <nova:name>tempest-TestStampPattern-server-1561718750</nova:name>
Nov 27 04:52:08 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:52:08</nova:creationTime>
Nov 27 04:52:08 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:52:08 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:52:08 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:52:08 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:52:08 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:52:08 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:52:08 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:52:08 user nova-compute[75260]:       <nova:owner>
Nov 27 04:52:08 user nova-compute[75260]:         <nova:user uuid="82e2cb36c4904d189ad7b29f933f480e">tempest-TestStampPattern-785030743-project-member</nova:user>
Nov 27 04:52:08 user nova-compute[75260]:         <nova:project uuid="06c37c5e030f48b293656f786ea1aeef">tempest-TestStampPattern-785030743</nova:project>
Nov 27 04:52:08 user nova-compute[75260]:       </nova:owner>
Nov 27 04:52:08 user nova-compute[75260]:       <nova:root type="image" uuid="c8b18da7-d3b4-486d-bfd8-cfc6c2df8a36"/>
Nov 27 04:52:08 user nova-compute[75260]:       <nova:ports>
Nov 27 04:52:08 user nova-compute[75260]:         <nova:port uuid="abea12ed-6f73-4322-a892-6c29383eaece">
Nov 27 04:52:08 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 04:52:08 user nova-compute[75260]:         </nova:port>
Nov 27 04:52:08 user nova-compute[75260]:       </nova:ports>
Nov 27 04:52:08 user nova-compute[75260]:     </nova:instance>
Nov 27 04:52:08 user nova-compute[75260]:   </metadata>
Nov 27 04:52:08 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:52:08 user nova-compute[75260]:     <system>
Nov 27 04:52:08 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:52:08 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:52:08 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:52:08 user nova-compute[75260]:       <entry name="serial">f29594ea-2a52-48ac-acfd-66e16dea9dfd</entry>
Nov 27 04:52:08 user nova-compute[75260]:       <entry name="uuid">f29594ea-2a52-48ac-acfd-66e16dea9dfd</entry>
Nov 27 04:52:08 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:52:08 user nova-compute[75260]:     </system>
Nov 27 04:52:08 user nova-compute[75260]:   </sysinfo>
Nov 27 04:52:08 user nova-compute[75260]:   <os>
Nov 27 04:52:08 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:52:08 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:52:08 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:52:08 user nova-compute[75260]:   </os>
Nov 27 04:52:08 user nova-compute[75260]:   <features>
Nov 27 04:52:08 user nova-compute[75260]:     <acpi/>
Nov 27 04:52:08 user nova-compute[75260]:     <apic/>
Nov 27 04:52:08 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:52:08 user nova-compute[75260]:   </features>
Nov 27 04:52:08 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:52:08 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:52:08 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:52:08 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:52:08 user nova-compute[75260]:   </clock>
Nov 27 04:52:08 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:52:08 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:52:08 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:52:08 user nova-compute[75260]:   </cpu>
Nov 27 04:52:08 user nova-compute[75260]:   <devices>
Nov 27 04:52:08 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:52:08 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:52:08 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk"/>
Nov 27 04:52:08 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:52:08 user nova-compute[75260]:     </disk>
Nov 27 04:52:08 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:52:08 user nova-compute[75260]:       <mac address="fa:16:3e:91:84:60"/>
Nov 27 04:52:08 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:52:08 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:52:08 user nova-compute[75260]:       <target dev="tapabea12ed-6f"/>
Nov 27 04:52:08 user nova-compute[75260]:     </interface>
Nov 27 04:52:08 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:52:08 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/console.log" append="off"/>
Nov 27 04:52:08 user nova-compute[75260]:     </serial>
Nov 27 04:52:08 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:52:08 user nova-compute[75260]:     <video>
Nov 27 04:52:08 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:52:08 user nova-compute[75260]:     </video>
Nov 27 04:52:08 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:52:08 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:52:08 user nova-compute[75260]:     </rng>
Nov 27 04:52:08 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:52:08 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:52:08 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:52:08 user nova-compute[75260]:     </memballoon>
Nov 27 04:52:08 user nova-compute[75260]:   </devices>
Nov 27 04:52:08 user nova-compute[75260]: </domain>
Nov 27 04:52:08 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1561718750',display_name='tempest-TestStampPattern-server-1561718750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1561718750',id=32,image_ref='c8b18da7-d3b4-486d-bfd8-cfc6c2df8a36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEm4ycTHTc6irbNWzi82l/iS13TDWE7Tbj1uK6oYdFuMWX34xe8U7Ts31a/zWSA7B9JpTfl9arNxPKlrPcez9SIQg8qSky+ZGAnVKHoKPTF0lkUsqytbC2eApCQB/fW4Dw==',key_name='tempest-TestStampPattern-81536007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06c37c5e030f48b293656f786ea1aeef',ramdisk_id='',reservation_id='r-imdr0hma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60da14c7-b49d-454d-ba99-ec308c4ceb96',image_min_disk='1',image_min_ram='0',image_owner_id='06c37c5e030f48b293656f786ea1aeef',image_owner_project_name='tempest-TestStampPattern-785030743',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-785030743-project-member',image_user_id='82e2cb36c4904d189ad7b29f933f480e',network_allocated='True',owner_project_name='tempest-TestStampPattern-785030743',owner_user_name='tempest-TestStampPattern-785030743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:52:06Z,user_data=None,user_id='82e2cb36c4904d189ad7b29f933f480e',uuid=f29594ea-2a52-48ac-acfd-66e16dea9dfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converting VIF {"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:84:60,bridge_name='br-int',has_traffic_filtering=True,id=abea12ed-6f73-4322-a892-6c29383eaece,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabea12ed-6f') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG os_vif [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:84:60,bridge_name='br-int',has_traffic_filtering=True,id=abea12ed-6f73-4322-a892-6c29383eaece,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabea12ed-6f') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a86dd7dc-289f-5a6b-bb7d-3e9abea3904e', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:52:08 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:52:08 user nova-compute[75260]:   <source dev="/dev/sdg"/>
Nov 27 04:52:08 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:52:08 user nova-compute[75260]:   <serial>d0e039b7-5c3a-4ac7-8cbf-706b552a0168</serial>
Nov 27 04:52:08 user nova-compute[75260]: </disk>
Nov 27 04:52:08 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabea12ed-6f, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabea12ed-6f, col_values=(('qos', UUID('2aad6f0c-5096-48a5-8e82-2be1a6c3180c')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabea12ed-6f, col_values=(('external_ids', {'iface-id': 'abea12ed-6f73-4322-a892-6c29383eaece', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:84:60', 'vm-uuid': 'f29594ea-2a52-48ac-acfd-66e16dea9dfd'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:08 user nova-compute[75260]: INFO os_vif [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:84:60,bridge_name='br-int',has_traffic_filtering=True,id=abea12ed-6f73-4322-a892-6c29383eaece,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabea12ed-6f')
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:52:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] No VIF found with MAC fa:16:3e:91:84:60, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:52:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:52:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:52:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No VIF found with MAC fa:16:3e:17:4b:bb, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:52:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c907bcc6-40ff-44b9-a56b-ad28aede6c55 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.323s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:10 user nova-compute[75260]: INFO nova.compute.manager [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Rebuilding instance
Nov 27 04:52:10 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:52:10 user nova-compute[75260]: DEBUG nova.compute.manager [req-b73e2f7f-0f6d-4644-834b-3e284253bb0d req-fffa53bf-21a7-4f9d-a661-08caced7f025 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received event network-vif-plugged-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b73e2f7f-0f6d-4644-834b-3e284253bb0d req-fffa53bf-21a7-4f9d-a661-08caced7f025 service nova] Acquiring lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b73e2f7f-0f6d-4644-834b-3e284253bb0d req-fffa53bf-21a7-4f9d-a661-08caced7f025 service nova] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b73e2f7f-0f6d-4644-834b-3e284253bb0d req-fffa53bf-21a7-4f9d-a661-08caced7f025 service nova] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:10 user nova-compute[75260]: DEBUG nova.compute.manager [req-b73e2f7f-0f6d-4644-834b-3e284253bb0d req-fffa53bf-21a7-4f9d-a661-08caced7f025 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] No waiting events found dispatching network-vif-plugged-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:10 user nova-compute[75260]: WARNING nova.compute.manager [req-b73e2f7f-0f6d-4644-834b-3e284253bb0d req-fffa53bf-21a7-4f9d-a661-08caced7f025 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received unexpected event network-vif-plugged-abea12ed-6f73-4322-a892-6c29383eaece for instance with vm_state building and task_state spawning.
Nov 27 04:52:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:11 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Instance destroyed successfully.
Nov 27 04:52:11 user nova-compute[75260]: INFO nova.compute.manager [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Detaching volume d0e039b7-5c3a-4ac7-8cbf-706b552a0168
Nov 27 04:52:11 user nova-compute[75260]: INFO nova.virt.block_device [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Attempting to driver detach volume d0e039b7-5c3a-4ac7-8cbf-706b552a0168 from mountpoint /dev/vdb
Nov 27 04:52:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Attempting to detach device vdb from instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:52:11 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:52:11 user nova-compute[75260]:   <source dev="/dev/sdg"/>
Nov 27 04:52:11 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:52:11 user nova-compute[75260]:   <serial>d0e039b7-5c3a-4ac7-8cbf-706b552a0168</serial>
Nov 27 04:52:11 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:52:11 user nova-compute[75260]: </disk>
Nov 27 04:52:11 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:52:11 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully detached device vdb from instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec from the persistent domain config.
Nov 27 04:52:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esNnabOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:52:11 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c94438-5e2e-406a-bfc2-155ccc4fcc35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:52:11 user nova-compute[75260]: No targets found.
Nov 27 04:52:11 user nova-compute[75260]: iSNS:
Nov 27 04:52:11 user nova-compute[75260]: No targets found.
Nov 27 04:52:11 user nova-compute[75260]: STATIC:
Nov 27 04:52:11 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:52:11 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:11 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:11 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9
Nov 27 04:52:11 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:11 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:11 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b
Nov 27 04:52:11 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:11 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:11 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117
Nov 27 04:52:11 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:11 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:11 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168
Nov 27 04:52:11 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:11 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:11 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b
Nov 27 04:52:11 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:11 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:11 user nova-compute[75260]: FIRMWARE:
Nov 27 04:52:11 user nova-compute[75260]: No targets found.
Nov 27 04:52:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:52:11 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:52:11 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b030c91-2010-4d2a-a912-049deeb60215]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9e55ea-424b-46da-bdf8-b7fff35f99ec]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:11 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:11 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:52:11 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:11 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:11 user nova-compute[75260]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:52:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:11 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:11 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:52:11 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:11 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:11 user nova-compute[75260]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:52:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb741e1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168'): ({'sdg'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Removing single pathed devices sdg {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3203b1-3581-455f-97e1-36efd52c31d9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d692db-6efe-4ae7-967e-dd2dd1914163]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flushing IO for device /dev/sdg {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52d4895-46d0-404f-a6fd-ebbafe27f267]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:52:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f2e6b2-6f4f-48a8-98ed-79c6984c0b7a]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] SCSI volumes sdg have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c89b0ed-9ca0-40ad-a16a-1a8df09cf168]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee752b09-ef32-41a5-a9fe-6cc98e91bad3]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260]
Nov 27 04:52:12 user nova-compute[75260]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260] successful.
Nov 27 04:52:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dcdde8-d76e-4d38-a49d-15d4d88701aa]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== disconnect_volume: return (337ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received event network-vif-plugged-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] Acquiring lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] No waiting events found dispatching network-vif-plugged-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:12 user nova-compute[75260]: WARNING nova.compute.manager [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received unexpected event network-vif-plugged-abea12ed-6f73-4322-a892-6c29383eaece for instance with vm_state building and task_state spawning.
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-vif-unplugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] No waiting events found dispatching network-vif-unplugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:12 user nova-compute[75260]: WARNING nova.compute.manager [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received unexpected event network-vif-unplugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b for instance with vm_state active and task_state rebuilding.
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] No waiting events found dispatching network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:12 user nova-compute[75260]: WARNING nova.compute.manager [req-c389facd-c919-450c-8522-a1bd5d06fd8e req-b7d0ae48-50a4-4a0a-a325-aa1ea7ab7fa7 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received unexpected event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b for instance with vm_state active and task_state rebuilding.
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:52:12 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Instance spawned successfully.
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:52:12 user nova-compute[75260]: INFO nova.compute.manager [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Took 6.94 seconds to spawn the instance on the hypervisor.
Nov 27 04:52:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:52:12 user nova-compute[75260]: INFO nova.compute.manager [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Took 7.77 seconds to build instance.
Nov 27 04:52:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4bcfc723-2c5d-4d1b-8c10-97a0b8622086 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.871s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:13 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Instance destroyed successfully.
Nov 27 04:52:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-195716123',display_name='tempest-ServerActionsTestOtherA-server-1448587439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-195716123',id=30,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4R7s2prxxnZaQ+FL9NIcHHXMgfD6VF3HAU7eh7ww4DCPun1aOULgPRw6EAugomVlJUlPfVA9bor4qx9I5jy6H2NQrtP0cswCG82jNOmi6CoeOEhcRtUcgxt3wrB3pMsw==',key_name='tempest-keypair-1968778781',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:50:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-79585enr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:52:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=97fdc474-4f43-40fa-b33f-a7e1e380f4ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_vif [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ee2fcfd-34, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86d0fd94-1a5e-4d98-b95e-da39ed6d3efe) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:13 user nova-compute[75260]: INFO os_vif [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34')
Nov 27 04:52:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esNnabOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:52:13 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d8b508-ec1e-4747-8f1e-2a9d0414ff17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:52:13 user nova-compute[75260]: No targets found.
Nov 27 04:52:13 user nova-compute[75260]: iSNS:
Nov 27 04:52:13 user nova-compute[75260]: No targets found.
Nov 27 04:52:13 user nova-compute[75260]: STATIC:
Nov 27 04:52:13 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:52:13 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:13 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:13 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9
Nov 27 04:52:13 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:13 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:13 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b
Nov 27 04:52:13 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:13 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:13 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117
Nov 27 04:52:13 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:13 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:13 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b
Nov 27 04:52:13 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:13 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:13 user nova-compute[75260]: FIRMWARE:
Nov 27 04:52:13 user nova-compute[75260]: No targets found.
Nov 27 04:52:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:52:13 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:52:13 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcc76d6-4c0b-451c-889c-fa6a2678eeb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f6011c-536e-49d6-a0fc-a2146ec1e8fb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:13 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:13 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:52:13 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:13 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:13 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:13 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:52:13 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:13 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb544a3be0>, {}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Disconnecting from: [] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== disconnect_volume: return (83ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:52:13 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Deleting instance files /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec_del
Nov 27 04:52:13 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Deletion of /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec_del complete
Nov 27 04:52:13 user nova-compute[75260]: INFO nova.virt.block_device [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Booting with volume d0e039b7-5c3a-4ac7-8cbf-706b552a0168 at /dev/vdb
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.utils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db3f4f-3599-42b0-9a91-5216580417e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f5802e-969c-4d5d-b36a-91508ce92f0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd092e1-d6e7-4e62-83f2-0258903cdcc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8dbb58-aed1-4338-a82e-ab1c157b16e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:52:13 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e886734-dd63-44b0-9426-73f42d955f3b]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG os_brick.utils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Updating existing volume attachment record: 707725da-e6a5-4ecd-b789-3eebb6d32a45 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "3079fe74-317c-4325-9667-45a6754af567" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "3079fe74-317c-4325-9667-45a6754af567-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:13 user nova-compute[75260]: INFO nova.compute.manager [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Terminating instance
Nov 27 04:52:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-7f3fb05d-fdb4-4dee-8531-09f9e01f7f1f req-ce52c4bd-ebcf-4562-bed1-ac452c4ece0b service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received event network-vif-unplugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7f3fb05d-fdb4-4dee-8531-09f9e01f7f1f req-ce52c4bd-ebcf-4562-bed1-ac452c4ece0b service nova] Acquiring lock "3079fe74-317c-4325-9667-45a6754af567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7f3fb05d-fdb4-4dee-8531-09f9e01f7f1f req-ce52c4bd-ebcf-4562-bed1-ac452c4ece0b service nova] Lock "3079fe74-317c-4325-9667-45a6754af567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7f3fb05d-fdb4-4dee-8531-09f9e01f7f1f req-ce52c4bd-ebcf-4562-bed1-ac452c4ece0b service nova] Lock "3079fe74-317c-4325-9667-45a6754af567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-7f3fb05d-fdb4-4dee-8531-09f9e01f7f1f req-ce52c4bd-ebcf-4562-bed1-ac452c4ece0b service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] No waiting events found dispatching network-vif-unplugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-7f3fb05d-fdb4-4dee-8531-09f9e01f7f1f req-ce52c4bd-ebcf-4562-bed1-ac452c4ece0b service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received event network-vif-unplugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 3079fe74-317c-4325-9667-45a6754af567] Instance destroyed successfully.
Nov 27 04:52:14 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lazy-loading 'resources' on Instance uuid 3079fe74-317c-4325-9667-45a6754af567 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2031966221',display_name='tempest-AttachVolumeNegativeTest-server-2031966221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2031966221',id=28,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoJaNZ0zgjmRild6Z5cxzEnhy9R4Sm8sV/rbA0Snj7iJ4yAvU8HjLMKMaGD9hT5SxCvcAVug43+mBo6zjpyX/ig1MQlzJGW5kIHzIZvaY0rNM5XZb8ZbTHYu0MFOTewfQ==',key_name='tempest-keypair-1106994504',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:49:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a01c78567be4d4ca62fd53ad2937ff5',ramdisk_id='',reservation_id='r-jmuzvatq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1561165574',owner_user_name='tempest-AttachVolumeNegativeTest-1561165574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1b9f31e8cfe433ba6988d8be95ff00c',uuid=3079fe74-317c-4325-9667-45a6754af567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converting VIF {"id": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "address": "fa:16:3e:98:56:60", "network": {"id": "d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1536037882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a01c78567be4d4ca62fd53ad2937ff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99a93fb-24", "ovs_interfaceid": "a99a93fb-2492-43cd-be0b-04fbcf66e165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:56:60,bridge_name='br-int',has_traffic_filtering=True,id=a99a93fb-2492-43cd-be0b-04fbcf66e165,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99a93fb-24') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG os_vif [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:56:60,bridge_name='br-int',has_traffic_filtering=True,id=a99a93fb-2492-43cd-be0b-04fbcf66e165,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99a93fb-24') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa99a93fb-24, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7508d5f-23cb-4add-add5-d7de0ba09a9e) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:14 user nova-compute[75260]: INFO os_vif [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:56:60,bridge_name='br-int',has_traffic_filtering=True,id=a99a93fb-2492-43cd-be0b-04fbcf66e165,network=Network(d58d7c61-26a0-4bc3-9e6b-0bf470f9f8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99a93fb-24')
Nov 27 04:52:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Deleting instance files /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567_del
Nov 27 04:52:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Deletion of /opt/stack/data/nova/instances/3079fe74-317c-4325-9667-45a6754af567_del complete
Nov 27 04:52:14 user nova-compute[75260]: INFO nova.compute.manager [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] [instance: 3079fe74-317c-4325-9667-45a6754af567] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 27 04:52:14 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 3079fe74-317c-4325-9667-45a6754af567] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:52:14 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 3079fe74-317c-4325-9667-45a6754af567] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:52:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 is timed out.
Nov 27 04:52:15 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully detached device vdb from instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 from the live domain config.
Nov 27 04:52:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEsmtdGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:52:15 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee824967-3ec4-474a-852a-4d3b48905ea2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:52:15 user nova-compute[75260]: No targets found.
Nov 27 04:52:15 user nova-compute[75260]: iSNS:
Nov 27 04:52:15 user nova-compute[75260]: No targets found.
Nov 27 04:52:15 user nova-compute[75260]: STATIC:
Nov 27 04:52:15 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:52:15 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:15 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:15 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9
Nov 27 04:52:15 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:15 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:15 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b
Nov 27 04:52:15 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:15 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:15 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117
Nov 27 04:52:15 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:15 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:15 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b
Nov 27 04:52:15 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:15 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:15 user nova-compute[75260]: FIRMWARE:
Nov 27 04:52:15 user nova-compute[75260]: No targets found.
Nov 27 04:52:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:52:15 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:52:15 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6699aea6-675d-49f5-af79-3135466b5816]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c164ac-7658-44a4-a9ef-0a8cc1b7ce4e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:15 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:15 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:52:15 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:15 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:15 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:15 user nova-compute[75260]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b (non-flash)
Nov 27 04:52:15 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:15 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54462b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f0c1c1-5abe-4995-9a49-38e9a4484e22]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49c760e-717a-408b-8aa0-5010f715d22a]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b1b792-068c-420b-815d-2760a78571a4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8aed51-e470-46d7-9620-72bed5adb822]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe94d524-e67a-40b3-8d6c-373977bdac02]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2399e040-a17c-495a-9317-92403dfb14d0]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b, portal: 172.16.0.220,3260]
Nov 27 04:52:15 user nova-compute[75260]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b, portal: 172.16.0.220,3260] successful.
Nov 27 04:52:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2d7b61f-3809-4378-acc2-88928a876a9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[72967fe8-100f-4ae2-9b71-eb14aa320dad]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== disconnect_volume: return (360ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 3079fe74-317c-4325-9667-45a6754af567] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:52:15 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 3079fe74-317c-4325-9667-45a6754af567] Took 1.14 seconds to deallocate network for instance.
Nov 27 04:52:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-cf9dc0dd-c7d6-4d23-b208-e5a9020444e7 req-0e184e6f-3564-4e76-bc33-9637a298c949 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received event network-vif-deleted-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:15 user nova-compute[75260]: INFO nova.compute.manager [req-cf9dc0dd-c7d6-4d23-b208-e5a9020444e7 req-0e184e6f-3564-4e76-bc33-9637a298c949 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Neutron deleted interface a99a93fb-2492-43cd-be0b-04fbcf66e165; detaching it from the instance and deleting it from the info cache
Nov 27 04:52:15 user nova-compute[75260]: DEBUG nova.network.neutron [req-cf9dc0dd-c7d6-4d23-b208-e5a9020444e7 req-0e184e6f-3564-4e76-bc33-9637a298c949 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-cf9dc0dd-c7d6-4d23-b208-e5a9020444e7 req-0e184e6f-3564-4e76-bc33-9637a298c949 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Detach interface failed, port_id=a99a93fb-2492-43cd-be0b-04fbcf66e165, reason: Instance 3079fe74-317c-4325-9667-45a6754af567 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:16 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Deleted allocations for instance 3079fe74-317c-4325-9667-45a6754af567
Nov 27 04:52:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a38cc7f-bdbf-4197-9367-608241589dad tempest-AttachVolumeNegativeTest-1561165574 tempest-AttachVolumeNegativeTest-1561165574-project-member] Lock "3079fe74-317c-4325-9667-45a6754af567" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.713s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-c52bf5c4-07f2-42d6-9f2c-fb3c5937799b req-a69a6e54-c2b3-419d-a84c-d71408b17605 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received event network-vif-plugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c52bf5c4-07f2-42d6-9f2c-fb3c5937799b req-a69a6e54-c2b3-419d-a84c-d71408b17605 service nova] Acquiring lock "3079fe74-317c-4325-9667-45a6754af567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c52bf5c4-07f2-42d6-9f2c-fb3c5937799b req-a69a6e54-c2b3-419d-a84c-d71408b17605 service nova] Lock "3079fe74-317c-4325-9667-45a6754af567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c52bf5c4-07f2-42d6-9f2c-fb3c5937799b req-a69a6e54-c2b3-419d-a84c-d71408b17605 service nova] Lock "3079fe74-317c-4325-9667-45a6754af567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-c52bf5c4-07f2-42d6-9f2c-fb3c5937799b req-a69a6e54-c2b3-419d-a84c-d71408b17605 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] No waiting events found dispatching network-vif-plugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:16 user nova-compute[75260]: WARNING nova.compute.manager [req-c52bf5c4-07f2-42d6-9f2c-fb3c5937799b req-a69a6e54-c2b3-419d-a84c-d71408b17605 service nova] [instance: 3079fe74-317c-4325-9667-45a6754af567] Received unexpected event network-vif-plugged-a99a93fb-2492-43cd-be0b-04fbcf66e165 for instance with vm_state deleted and task_state None.
Nov 27 04:52:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:16 user nova-compute[75260]: INFO nova.compute.manager [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Detaching volume 6b10a262-7bfe-446c-b417-1e10d73c3117
Nov 27 04:52:16 user nova-compute[75260]: INFO nova.virt.block_device [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Attempting to driver detach volume 6b10a262-7bfe-446c-b417-1e10d73c3117 from mountpoint /dev/vdb
Nov 27 04:52:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Attempting to detach device vdb from instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:52:16 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:52:16 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:52:16 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:52:16 user nova-compute[75260]:   <serial>6b10a262-7bfe-446c-b417-1e10d73c3117</serial>
Nov 27 04:52:16 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:52:16 user nova-compute[75260]: </disk>
Nov 27 04:52:16 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:52:16 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Successfully detached device vdb from instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 from the persistent domain config.
Nov 27 04:52:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:52:16 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:52:16 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:52:16 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:52:16 user nova-compute[75260]:   <serial>6b10a262-7bfe-446c-b417-1e10d73c3117</serial>
Nov 27 04:52:16 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:52:16 user nova-compute[75260]: </disk>
Nov 27 04:52:16 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:52:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:52:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:20 user nova-compute[75260]: DEBUG nova.objects.instance [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-82deaed9-ca9a-4e68-a5cd-0b915b5c6331 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.628s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:21 user nova-compute[75260]: INFO nova.compute.manager [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Detaching volume e8da4aff-7aad-4990-a945-148ceaf2ce4b
Nov 27 04:52:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:52:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Creating image(s)
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "/opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "/opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "/opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:21 user nova-compute[75260]: INFO nova.virt.block_device [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Attempting to driver detach volume e8da4aff-7aad-4990-a945-148ceaf2ce4b from mountpoint /dev/vdc
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Attempting to detach device vdc from instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:52:21 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:52:21 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:52:21 user nova-compute[75260]:   <target dev="vdc" bus="virtio"/>
Nov 27 04:52:21 user nova-compute[75260]:   <serial>e8da4aff-7aad-4990-a945-148ceaf2ce4b</serial>
Nov 27 04:52:21 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 04:52:21 user nova-compute[75260]: </disk>
Nov 27 04:52:21 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:52:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully detached device vdc from instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 from the persistent domain config.
Nov 27 04:52:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:52:21 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:52:21 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:52:21 user nova-compute[75260]:   <target dev="vdc" bus="virtio"/>
Nov 27 04:52:21 user nova-compute[75260]:   <serial>e8da4aff-7aad-4990-a945-148ceaf2ce4b</serial>
Nov 27 04:52:21 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 04:52:21 user nova-compute[75260]: </disk>
Nov 27 04:52:21 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.184s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk 1073741824" returned: 0 in 0.054s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Cannot resize image /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Ensure instance console log exists: /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Start _get_guest_xml network_info=[{"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '707725da-e6a5-4ecd-b789-3eebb6d32a45', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esNnabOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97fdc474-4f43-40fa-b33f-a7e1e380f4ec', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0e039b7-5c3a-4ac7-8cbf-706b552a0168', 'serial': 'd0e039b7-5c3a-4ac7-8cbf-706b552a0168'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:52:22 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 27 04:52:22 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97fdc474-4f43-40fa-b33f-a7e1e380f4ec {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esNnabOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:52:22 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:52:22 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:52:22 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[72266761-750e-4231-968f-b56f5cbae799]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:52:22 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea970a01-07dd-436c-a1e3-779503407cce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168] added
Nov 27 04:52:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f978508-14ad-40a2-a11a-fba36fabbad9]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3283e91e-565c-48a1-9b24-4b725361c0a8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v esNnabOH {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v esNnabOH" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ee396b-1e83-4e73-b726-004c6520d8f9]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'esNnabOH'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.152s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d930e0-97c3-4bfb-bdd8-d2ee851b9ece]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1496259-971d-4d8a-9452-450add9763aa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd8fa6-006e-42c3-96aa-1c91f52cc4ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260]
Nov 27 04:52:22 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260] successful.
Nov 27 04:52:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aca9dd-a985-4186-ad14-7c389f4497b0]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1c9952-1d96-411b-a163-0c9dd74bbf74]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:52:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:22 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:52:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f148606d-df51-479d-b83a-6e5a112193b4]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:52:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esNnabOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '23662656338313662', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662656338313662', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T04:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-195716123',display_name='tempest-ServerActionsTestOtherA-server-1448587439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-195716123',id=30,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4R7s2prxxnZaQ+FL9NIcHHXMgfD6VF3HAU7eh7ww4DCPun1aOULgPRw6EAugomVlJUlPfVA9bor4qx9I5jy6H2NQrtP0cswCG82jNOmi6CoeOEhcRtUcgxt3wrB3pMsw==',key_name='tempest-keypair-1968778781',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:50:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-79585enr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:52:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=97fdc474-4f43-40fa-b33f-a7e1e380f4ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:52:23 user nova-compute[75260]:   <uuid>97fdc474-4f43-40fa-b33f-a7e1e380f4ec</uuid>
Nov 27 04:52:23 user nova-compute[75260]:   <name>instance-0000001e</name>
Nov 27 04:52:23 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:52:23 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:52:23 user nova-compute[75260]:   <metadata>
Nov 27 04:52:23 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:52:23 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:52:23 user nova-compute[75260]:       <nova:name>tempest-ServerActionsTestOtherA-server-1448587439</nova:name>
Nov 27 04:52:23 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:52:22</nova:creationTime>
Nov 27 04:52:23 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:52:23 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:52:23 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:52:23 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:52:23 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:52:23 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:52:23 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:52:23 user nova-compute[75260]:       <nova:owner>
Nov 27 04:52:23 user nova-compute[75260]:         <nova:user uuid="71baa1a857c5458ea2d03515ea2ccaf3">tempest-ServerActionsTestOtherA-678795315-project-member</nova:user>
Nov 27 04:52:23 user nova-compute[75260]:         <nova:project uuid="a344ddbabc8e48e9987d8aa73042821a">tempest-ServerActionsTestOtherA-678795315</nova:project>
Nov 27 04:52:23 user nova-compute[75260]:       </nova:owner>
Nov 27 04:52:23 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:52:23 user nova-compute[75260]:       <nova:ports>
Nov 27 04:52:23 user nova-compute[75260]:         <nova:port uuid="3ee2fcfd-34f7-45ae-b191-e8459d03647b">
Nov 27 04:52:23 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 04:52:23 user nova-compute[75260]:         </nova:port>
Nov 27 04:52:23 user nova-compute[75260]:       </nova:ports>
Nov 27 04:52:23 user nova-compute[75260]:     </nova:instance>
Nov 27 04:52:23 user nova-compute[75260]:   </metadata>
Nov 27 04:52:23 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:52:23 user nova-compute[75260]:     <system>
Nov 27 04:52:23 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:52:23 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:52:23 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:52:23 user nova-compute[75260]:       <entry name="serial">97fdc474-4f43-40fa-b33f-a7e1e380f4ec</entry>
Nov 27 04:52:23 user nova-compute[75260]:       <entry name="uuid">97fdc474-4f43-40fa-b33f-a7e1e380f4ec</entry>
Nov 27 04:52:23 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:52:23 user nova-compute[75260]:     </system>
Nov 27 04:52:23 user nova-compute[75260]:   </sysinfo>
Nov 27 04:52:23 user nova-compute[75260]:   <os>
Nov 27 04:52:23 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:52:23 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:52:23 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:52:23 user nova-compute[75260]:   </os>
Nov 27 04:52:23 user nova-compute[75260]:   <features>
Nov 27 04:52:23 user nova-compute[75260]:     <acpi/>
Nov 27 04:52:23 user nova-compute[75260]:     <apic/>
Nov 27 04:52:23 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:52:23 user nova-compute[75260]:   </features>
Nov 27 04:52:23 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:52:23 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:52:23 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:52:23 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:52:23 user nova-compute[75260]:   </clock>
Nov 27 04:52:23 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:52:23 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:52:23 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:52:23 user nova-compute[75260]:   </cpu>
Nov 27 04:52:23 user nova-compute[75260]:   <devices>
Nov 27 04:52:23 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:52:23 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:52:23 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk"/>
Nov 27 04:52:23 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:52:23 user nova-compute[75260]:     </disk>
Nov 27 04:52:23 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:52:23 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:52:23 user nova-compute[75260]:       <source dev="/dev/sdd"/>
Nov 27 04:52:23 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:52:23 user nova-compute[75260]:       <serial>d0e039b7-5c3a-4ac7-8cbf-706b552a0168</serial>
Nov 27 04:52:23 user nova-compute[75260]:     </disk>
Nov 27 04:52:23 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:52:23 user nova-compute[75260]:       <mac address="fa:16:3e:17:4b:bb"/>
Nov 27 04:52:23 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:52:23 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:52:23 user nova-compute[75260]:       <target dev="tap3ee2fcfd-34"/>
Nov 27 04:52:23 user nova-compute[75260]:     </interface>
Nov 27 04:52:23 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:52:23 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/console.log" append="off"/>
Nov 27 04:52:23 user nova-compute[75260]:     </serial>
Nov 27 04:52:23 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:52:23 user nova-compute[75260]:     <video>
Nov 27 04:52:23 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:52:23 user nova-compute[75260]:     </video>
Nov 27 04:52:23 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:52:23 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:52:23 user nova-compute[75260]:     </rng>
Nov 27 04:52:23 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:52:23 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:52:23 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:52:23 user nova-compute[75260]:     </memballoon>
Nov 27 04:52:23 user nova-compute[75260]:   </devices>
Nov 27 04:52:23 user nova-compute[75260]: </domain>
Nov 27 04:52:23 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T04:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-195716123',display_name='tempest-ServerActionsTestOtherA-server-1448587439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-195716123',id=30,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4R7s2prxxnZaQ+FL9NIcHHXMgfD6VF3HAU7eh7ww4DCPun1aOULgPRw6EAugomVlJUlPfVA9bor4qx9I5jy6H2NQrtP0cswCG82jNOmi6CoeOEhcRtUcgxt3wrB3pMsw==',key_name='tempest-keypair-1968778781',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:50:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-79585enr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:52:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=97fdc474-4f43-40fa-b33f-a7e1e380f4ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG os_vif [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3eaf7558-4ff9-525e-9ae1-248d70215fa8', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ee2fcfd-34, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ee2fcfd-34, col_values=(('qos', UUID('9e716980-26c4-4e05-9ccd-9124feb60b1e')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ee2fcfd-34, col_values=(('external_ids', {'iface-id': '3ee2fcfd-34f7-45ae-b191-e8459d03647b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:4b:bb', 'vm-uuid': '97fdc474-4f43-40fa-b33f-a7e1e380f4ec'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:23 user nova-compute[75260]: INFO os_vif [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34')
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:52:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No VIF found with MAC fa:16:3e:17:4b:bb, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:52:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-13c3d674-1e8c-4d6a-b04a-c7bb5294663d req-8cef6803-3403-403f-80d7-42f70b91a99f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-13c3d674-1e8c-4d6a-b04a-c7bb5294663d req-8cef6803-3403-403f-80d7-42f70b91a99f service nova] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-13c3d674-1e8c-4d6a-b04a-c7bb5294663d req-8cef6803-3403-403f-80d7-42f70b91a99f service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-13c3d674-1e8c-4d6a-b04a-c7bb5294663d req-8cef6803-3403-403f-80d7-42f70b91a99f service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-13c3d674-1e8c-4d6a-b04a-c7bb5294663d req-8cef6803-3403-403f-80d7-42f70b91a99f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] No waiting events found dispatching network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:25 user nova-compute[75260]: WARNING nova.compute.manager [req-13c3d674-1e8c-4d6a-b04a-c7bb5294663d req-8cef6803-3403-403f-80d7-42f70b91a99f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received unexpected event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b for instance with vm_state active and task_state rebuild_spawning.
Nov 27 04:52:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:52:27 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Instance spawned successfully.
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-10a3ce6f-ab1c-498e-a46b-3bc0958552dc req-27b5e859-13ee-4a02-bb96-dccc7ee3878f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10a3ce6f-ab1c-498e-a46b-3bc0958552dc req-27b5e859-13ee-4a02-bb96-dccc7ee3878f service nova] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10a3ce6f-ab1c-498e-a46b-3bc0958552dc req-27b5e859-13ee-4a02-bb96-dccc7ee3878f service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10a3ce6f-ab1c-498e-a46b-3bc0958552dc req-27b5e859-13ee-4a02-bb96-dccc7ee3878f service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-10a3ce6f-ab1c-498e-a46b-3bc0958552dc req-27b5e859-13ee-4a02-bb96-dccc7ee3878f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] No waiting events found dispatching network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:27 user nova-compute[75260]: WARNING nova.compute.manager [req-10a3ce6f-ab1c-498e-a46b-3bc0958552dc req-27b5e859-13ee-4a02-bb96-dccc7ee3878f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received unexpected event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b for instance with vm_state active and task_state rebuild_spawning.
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75260) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 27 04:52:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2c376ddc-f64e-4741-857d-74ccdccbdff5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "d0364679-4db1-4da8-bce8-80eea41feb13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "d0364679-4db1-4da8-bce8-80eea41feb13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:29 user nova-compute[75260]: INFO nova.compute.manager [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Terminating instance
Nov 27 04:52:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-63254645-b27d-4d30-9cbb-972a82bc662e req-122e9586-5b62-47cb-87f8-75bb64bf0aa3 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Received event network-vif-unplugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-63254645-b27d-4d30-9cbb-972a82bc662e req-122e9586-5b62-47cb-87f8-75bb64bf0aa3 service nova] Acquiring lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-63254645-b27d-4d30-9cbb-972a82bc662e req-122e9586-5b62-47cb-87f8-75bb64bf0aa3 service nova] Lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-63254645-b27d-4d30-9cbb-972a82bc662e req-122e9586-5b62-47cb-87f8-75bb64bf0aa3 service nova] Lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-63254645-b27d-4d30-9cbb-972a82bc662e req-122e9586-5b62-47cb-87f8-75bb64bf0aa3 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] No waiting events found dispatching network-vif-unplugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-63254645-b27d-4d30-9cbb-972a82bc662e req-122e9586-5b62-47cb-87f8-75bb64bf0aa3 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Received event network-vif-unplugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:52:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Instance destroyed successfully.
Nov 27 04:52:29 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lazy-loading 'resources' on Instance uuid d0364679-4db1-4da8-bce8-80eea41feb13 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-98185851',display_name='tempest-ServersNegativeTestJSON-server-98185851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-98185851',id=16,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2fd7cc4144d4422a140157d994f8c06',ramdisk_id='',reservation_id='r-zl39l0w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1694781308',owner_user_name='tempest-ServersNegativeTestJSON-1694781308-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:43:51Z,user_data=None,user_id='1f5e727696d94f35a7f111cfa01a2530',uuid=d0364679-4db1-4da8-bce8-80eea41feb13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converting VIF {"id": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "address": "fa:16:3e:45:75:78", "network": {"id": "f0baa952-9675-4734-8ed8-0e356b276f62", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-402657150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2fd7cc4144d4422a140157d994f8c06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0f9e10-c1", "ovs_interfaceid": "7b0f9e10-c1fa-4a44-9521-cc419eb2dab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:75:78,bridge_name='br-int',has_traffic_filtering=True,id=7b0f9e10-c1fa-4a44-9521-cc419eb2dab6,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0f9e10-c1') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG os_vif [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:75:78,bridge_name='br-int',has_traffic_filtering=True,id=7b0f9e10-c1fa-4a44-9521-cc419eb2dab6,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0f9e10-c1') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b0f9e10-c1, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c1c5fb0-2031-4c62-a53b-41dc46bd62d1) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:52:29 user nova-compute[75260]: INFO os_vif [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:75:78,bridge_name='br-int',has_traffic_filtering=True,id=7b0f9e10-c1fa-4a44-9521-cc419eb2dab6,network=Network(f0baa952-9675-4734-8ed8-0e356b276f62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0f9e10-c1')
Nov 27 04:52:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Deleting instance files /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13_del
Nov 27 04:52:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Deletion of /opt/stack/data/nova/instances/d0364679-4db1-4da8-bce8-80eea41feb13_del complete
Nov 27 04:52:30 user nova-compute[75260]: INFO nova.compute.manager [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 27 04:52:30 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:52:30 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:52:30 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:52:30 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:52:30 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Took 0.50 seconds to deallocate network for instance.
Nov 27 04:52:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-f8537e56-eb27-4146-8edc-41cb4bc84273 req-8d7c9583-3f9f-43d8-9233-836f07c2ebfb service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Received event network-vif-deleted-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:30 user nova-compute[75260]: INFO nova.compute.manager [req-f8537e56-eb27-4146-8edc-41cb4bc84273 req-8d7c9583-3f9f-43d8-9233-836f07c2ebfb service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Neutron deleted interface 7b0f9e10-c1fa-4a44-9521-cc419eb2dab6; detaching it from the instance and deleting it from the info cache
Nov 27 04:52:30 user nova-compute[75260]: DEBUG nova.network.neutron [req-f8537e56-eb27-4146-8edc-41cb4bc84273 req-8d7c9583-3f9f-43d8-9233-836f07c2ebfb service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:52:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-f8537e56-eb27-4146-8edc-41cb4bc84273 req-8d7c9583-3f9f-43d8-9233-836f07c2ebfb service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Detach interface failed, port_id=7b0f9e10-c1fa-4a44-9521-cc419eb2dab6, reason: Instance d0364679-4db1-4da8-bce8-80eea41feb13 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:52:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:30 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:52:30 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:52:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:31 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Deleted allocations for instance d0364679-4db1-4da8-bce8-80eea41feb13
Nov 27 04:52:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d5dbc1f-7f1b-4578-9086-9dc36b33d061 tempest-ServersNegativeTestJSON-1694781308 tempest-ServersNegativeTestJSON-1694781308-project-member] Lock "d0364679-4db1-4da8-bce8-80eea41feb13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.014s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-c844ea31-7e46-4d0e-b317-64e033deb002 req-cecc9238-5c02-4511-a7ed-29bb11423849 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Received event network-vif-plugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c844ea31-7e46-4d0e-b317-64e033deb002 req-cecc9238-5c02-4511-a7ed-29bb11423849 service nova] Acquiring lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c844ea31-7e46-4d0e-b317-64e033deb002 req-cecc9238-5c02-4511-a7ed-29bb11423849 service nova] Lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c844ea31-7e46-4d0e-b317-64e033deb002 req-cecc9238-5c02-4511-a7ed-29bb11423849 service nova] Lock "d0364679-4db1-4da8-bce8-80eea41feb13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-c844ea31-7e46-4d0e-b317-64e033deb002 req-cecc9238-5c02-4511-a7ed-29bb11423849 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] No waiting events found dispatching network-vif-plugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:31 user nova-compute[75260]: WARNING nova.compute.manager [req-c844ea31-7e46-4d0e-b317-64e033deb002 req-cecc9238-5c02-4511-a7ed-29bb11423849 service nova] [instance: d0364679-4db1-4da8-bce8-80eea41feb13] Received unexpected event network-vif-plugged-7b0f9e10-c1fa-4a44-9521-cc419eb2dab6 for instance with vm_state deleted and task_state None.
Nov 27 04:52:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:37 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 is timed out.
Nov 27 04:52:37 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Successfully detached device vdb from instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 from the live domain config.
Nov 27 04:52:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqehPLBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:52:37 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ece7f8-73c0-4474-9e96-812e039c6557]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:52:37 user nova-compute[75260]: No targets found.
Nov 27 04:52:37 user nova-compute[75260]: iSNS:
Nov 27 04:52:37 user nova-compute[75260]: No targets found.
Nov 27 04:52:37 user nova-compute[75260]: STATIC:
Nov 27 04:52:37 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:52:37 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:37 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:37 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9
Nov 27 04:52:37 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:37 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:37 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117
Nov 27 04:52:37 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:37 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:37 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168
Nov 27 04:52:37 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:37 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:37 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b
Nov 27 04:52:37 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:37 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:37 user nova-compute[75260]: FIRMWARE:
Nov 27 04:52:37 user nova-compute[75260]: No targets found.
Nov 27 04:52:37 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:52:37 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:52:37 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a95bb7b-4503-47b7-b3c9-6b691954797c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d303c1-098e-4e44-b6a2-428a99d810a0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:37 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:37 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:37 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:37 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:52:37 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:37 user nova-compute[75260]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 (non-flash)
Nov 27 04:52:37 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:37 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:37 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:52:37 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb7422dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3d1d29-947d-451c-8821-04bc2712a9a9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3a99d3-56fa-49c8-ae60-5c887fc65202]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f0718-111d-44ec-955e-6774739c080b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3938ed-b88e-4716-afcc-48f318f39ad7]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ab4588-1b11-4234-b77c-9c50484b43eb]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1cf934-f1ad-4f3e-a237-f7cb6438c85d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117, portal: 172.16.0.220,3260]
Nov 27 04:52:37 user nova-compute[75260]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117, portal: 172.16.0.220,3260] successful.
Nov 27 04:52:37 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b10a262-7bfe-446c-b417-1e10d73c3117 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0160d59-41cf-4212-bdc3-176d2d6dc580]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] <== disconnect_volume: return (325ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:52:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:52:38 user nova-compute[75260]: DEBUG nova.objects.instance [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'flavor' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:52:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d5dfd1b5-13ff-4ce7-91f2-48055a710d98 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:41 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 is timed out.
Nov 27 04:52:41 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully detached device vdc from instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 from the live domain config.
Nov 27 04:52:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKDsNFzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:52:41 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:52:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eee1bf-41f1-4a71-b361-73251e959ec3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:52:41 user nova-compute[75260]: No targets found.
Nov 27 04:52:41 user nova-compute[75260]: iSNS:
Nov 27 04:52:41 user nova-compute[75260]: No targets found.
Nov 27 04:52:41 user nova-compute[75260]: STATIC:
Nov 27 04:52:41 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:52:41 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:41 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:41 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9
Nov 27 04:52:41 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:41 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:41 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168
Nov 27 04:52:41 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:41 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:41 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b
Nov 27 04:52:41 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:52:41 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:52:41 user nova-compute[75260]: FIRMWARE:
Nov 27 04:52:41 user nova-compute[75260]: No targets found.
Nov 27 04:52:41 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:52:41 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:52:41 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3819f51-ea05-44bc-939f-f2ad95003e1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ae5443-8a6f-4087-b85a-092858cec846]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:42 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:42 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:42 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:52:42 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:52:42 user nova-compute[75260]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b (non-flash)
Nov 27 04:52:42 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:52:42 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:52:42 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb5417b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b'): ({'sde'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Removing single pathed devices sde {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbead6e7-8d52-4ea0-bbdc-15c56491a4e9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ff2bd-58e5-4feb-83a2-f8dd292ac930]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Flushing IO for device /dev/sde {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.011s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a285a8c-e654-4afe-ac8b-b46780de97bd]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc81acab-0b56-4021-b4e9-70ab8354daf7]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[51341af3-7b7e-43c0-8967-b29582a26dc3]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89ddf14-8f24-484f-8283-9f81e0fe0092]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b, portal: 172.16.0.220,3260]
Nov 27 04:52:42 user nova-compute[75260]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b, portal: 172.16.0.220,3260] successful.
Nov 27 04:52:42 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8da4aff-7aad-4990-a945-148ceaf2ce4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caaf580-1451-4529-8cb6-57cfca140844]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] <== disconnect_volume: return (295ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG nova.objects.instance [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'flavor' on Instance uuid 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:52:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a201e977-d9a8-4676-b839-1580b7b7f10b tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.654s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:44 user nova-compute[75260]: INFO nova.compute.manager [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Terminating instance
Nov 27 04:52:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-d90fafea-b151-4609-a431-77b0e0ed27cb req-624ca91d-4165-4e01-a474-faf82a4cc5a4 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received event network-vif-unplugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d90fafea-b151-4609-a431-77b0e0ed27cb req-624ca91d-4165-4e01-a474-faf82a4cc5a4 service nova] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d90fafea-b151-4609-a431-77b0e0ed27cb req-624ca91d-4165-4e01-a474-faf82a4cc5a4 service nova] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d90fafea-b151-4609-a431-77b0e0ed27cb req-624ca91d-4165-4e01-a474-faf82a4cc5a4 service nova] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-d90fafea-b151-4609-a431-77b0e0ed27cb req-624ca91d-4165-4e01-a474-faf82a4cc5a4 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] No waiting events found dispatching network-vif-unplugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-d90fafea-b151-4609-a431-77b0e0ed27cb req-624ca91d-4165-4e01-a474-faf82a4cc5a4 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received event network-vif-unplugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:52:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Instance destroyed successfully.
Nov 27 04:52:45 user nova-compute[75260]: DEBUG nova.objects.instance [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lazy-loading 'resources' on Instance uuid 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1777132672',display_name='tempest-AttachVolumeTestJSON-server-1777132672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1777132672',id=29,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRrWocvrzj0wpRlpge4L2WZXMC2nLVE7223A1NSVX8DYDCR1B5b5CJ64cgLm/clNiqTFlCpXZfqV5DSSIsGxGDlh3aetA3Xt32CwY99EvYyUaY49cZI8uPmtW86Wao/Nw==',key_name='tempest-keypair-2040186399',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea8a8bd85b234d8e82487ead1232a644',ramdisk_id='',reservation_id='r-rzc1ueqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2145472694',owner_user_name='tempest-AttachVolumeTestJSON-2145472694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cbd63730ab84fa3aa9a05b06194ad4a',uuid=06c8aeb2-c1a1-4e84-b8e2-39755a779dc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converting VIF {"id": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "address": "fa:16:3e:d2:2e:2b", "network": {"id": "f214f410-4f05-4475-bac6-bde6c0c57021", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1158635387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea8a8bd85b234d8e82487ead1232a644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08e0a76-9a", "ovs_interfaceid": "b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:2e:2b,bridge_name='br-int',has_traffic_filtering=True,id=b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08e0a76-9a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG os_vif [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:2e:2b,bridge_name='br-int',has_traffic_filtering=True,id=b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08e0a76-9a') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb08e0a76-9a, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cba910e-336d-49c3-8882-f4729611565f) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:45 user nova-compute[75260]: INFO os_vif [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:2e:2b,bridge_name='br-int',has_traffic_filtering=True,id=b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95,network=Network(f214f410-4f05-4475-bac6-bde6c0c57021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08e0a76-9a')
Nov 27 04:52:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Deleting instance files /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5_del
Nov 27 04:52:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Deletion of /opt/stack/data/nova/instances/06c8aeb2-c1a1-4e84-b8e2-39755a779dc5_del complete
Nov 27 04:52:45 user nova-compute[75260]: INFO nova.compute.manager [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 27 04:52:45 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:52:45 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:52:46 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Took 0.66 seconds to deallocate network for instance.
Nov 27 04:52:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-196c6905-4ef3-4986-b082-5613155b5ccf req-f0ed31b8-c9f0-4825-b187-68658fbd208d service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received event network-vif-deleted-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:46 user nova-compute[75260]: INFO nova.compute.manager [req-196c6905-4ef3-4986-b082-5613155b5ccf req-f0ed31b8-c9f0-4825-b187-68658fbd208d service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Neutron deleted interface b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95; detaching it from the instance and deleting it from the info cache
Nov 27 04:52:46 user nova-compute[75260]: DEBUG nova.network.neutron [req-196c6905-4ef3-4986-b082-5613155b5ccf req-f0ed31b8-c9f0-4825-b187-68658fbd208d service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-196c6905-4ef3-4986-b082-5613155b5ccf req-f0ed31b8-c9f0-4825-b187-68658fbd208d service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Detach interface failed, port_id=b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95, reason: Instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:46 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Deleted allocations for instance 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5
Nov 27 04:52:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-16fe85c9-1712-4ec5-b78a-38b7df53c0a3 tempest-AttachVolumeTestJSON-2145472694 tempest-AttachVolumeTestJSON-2145472694-project-member] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.067s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-74ed9571-26a4-4206-8d0d-3600e347fa0b req-51e3db4c-4f1d-464d-84e0-de2db4df9ce7 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received event network-vif-plugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ed9571-26a4-4206-8d0d-3600e347fa0b req-51e3db4c-4f1d-464d-84e0-de2db4df9ce7 service nova] Acquiring lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ed9571-26a4-4206-8d0d-3600e347fa0b req-51e3db4c-4f1d-464d-84e0-de2db4df9ce7 service nova] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-74ed9571-26a4-4206-8d0d-3600e347fa0b req-51e3db4c-4f1d-464d-84e0-de2db4df9ce7 service nova] Lock "06c8aeb2-c1a1-4e84-b8e2-39755a779dc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-74ed9571-26a4-4206-8d0d-3600e347fa0b req-51e3db4c-4f1d-464d-84e0-de2db4df9ce7 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] No waiting events found dispatching network-vif-plugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:52:46 user nova-compute[75260]: WARNING nova.compute.manager [req-74ed9571-26a4-4206-8d0d-3600e347fa0b req-51e3db4c-4f1d-464d-84e0-de2db4df9ce7 service nova] [instance: 06c8aeb2-c1a1-4e84-b8e2-39755a779dc5] Received unexpected event network-vif-plugged-b08e0a76-9a78-4ae9-92b7-89ef1f3f0c95 for instance with vm_state deleted and task_state None.
Nov 27 04:52:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:54 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:52:54 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:52:54 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:52:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:52:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:52:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:52:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:52:54 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:52:54 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updating instance_info_cache with network_info: [{"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-7c01d799-540f-469b-8417-5af70d803adf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:52:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:52:59 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:52:59 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7631MB free_disk=25.138389587402344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance f29594ea-2a52-48ac-acfd-66e16dea9dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-26402a3b-a3dc-46b1-9f24-4692487344c3 req-c234b395-e6cf-493e-a821-1e73ddd4fcd9 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-changed-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-26402a3b-a3dc-46b1-9f24-4692487344c3 req-c234b395-e6cf-493e-a821-1e73ddd4fcd9 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Refreshing instance network info cache due to event network-changed-e8622473-aed7-41ef-923e-b8565a6783c2. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-26402a3b-a3dc-46b1-9f24-4692487344c3 req-c234b395-e6cf-493e-a821-1e73ddd4fcd9 service nova] Acquiring lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-26402a3b-a3dc-46b1-9f24-4692487344c3 req-c234b395-e6cf-493e-a821-1e73ddd4fcd9 service nova] Acquired lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:52:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-26402a3b-a3dc-46b1-9f24-4692487344c3 req-c234b395-e6cf-493e-a821-1e73ddd4fcd9 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Refreshing network info cache for port e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:53:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-26402a3b-a3dc-46b1-9f24-4692487344c3 req-c234b395-e6cf-493e-a821-1e73ddd4fcd9 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updated VIF entry in instance network info cache for port e8622473-aed7-41ef-923e-b8565a6783c2. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:53:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-26402a3b-a3dc-46b1-9f24-4692487344c3 req-c234b395-e6cf-493e-a821-1e73ddd4fcd9 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updating instance_info_cache with network_info: [{"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:53:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-26402a3b-a3dc-46b1-9f24-4692487344c3 req-c234b395-e6cf-493e-a821-1e73ddd4fcd9 service nova] Releasing lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:53:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:00 user nova-compute[75260]: INFO nova.compute.manager [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Detaching volume 1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9
Nov 27 04:53:00 user nova-compute[75260]: INFO nova.virt.block_device [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Attempting to driver detach volume 1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 from mountpoint /dev/vdb
Nov 27 04:53:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Attempting to detach device vdb from instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:53:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:53:00 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:53:00 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:53:00 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:53:00 user nova-compute[75260]:   <serial>1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9</serial>
Nov 27 04:53:00 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:53:00 user nova-compute[75260]: </disk>
Nov 27 04:53:00 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:53:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Successfully detached device vdb from instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 from the persistent domain config.
Nov 27 04:53:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:53:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:53:00 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:53:00 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:53:00 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:53:00 user nova-compute[75260]:   <serial>1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9</serial>
Nov 27 04:53:00 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:53:00 user nova-compute[75260]: </disk>
Nov 27 04:53:00 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:53:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:53:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-1bbf7510-4447-481c-b80e-310aa003de1c req-191bbacd-c62b-4a2f-a294-90246fee7a9a service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-changed-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-1bbf7510-4447-481c-b80e-310aa003de1c req-191bbacd-c62b-4a2f-a294-90246fee7a9a service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Refreshing instance network info cache due to event network-changed-e8622473-aed7-41ef-923e-b8565a6783c2. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:53:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1bbf7510-4447-481c-b80e-310aa003de1c req-191bbacd-c62b-4a2f-a294-90246fee7a9a service nova] Acquiring lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:53:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1bbf7510-4447-481c-b80e-310aa003de1c req-191bbacd-c62b-4a2f-a294-90246fee7a9a service nova] Acquired lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:53:02 user nova-compute[75260]: DEBUG nova.network.neutron [req-1bbf7510-4447-481c-b80e-310aa003de1c req-191bbacd-c62b-4a2f-a294-90246fee7a9a service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Refreshing network info cache for port e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:53:02 user nova-compute[75260]: DEBUG nova.network.neutron [req-1bbf7510-4447-481c-b80e-310aa003de1c req-191bbacd-c62b-4a2f-a294-90246fee7a9a service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updated VIF entry in instance network info cache for port e8622473-aed7-41ef-923e-b8565a6783c2. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:53:02 user nova-compute[75260]: DEBUG nova.network.neutron [req-1bbf7510-4447-481c-b80e-310aa003de1c req-191bbacd-c62b-4a2f-a294-90246fee7a9a service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updating instance_info_cache with network_info: [{"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:53:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1bbf7510-4447-481c-b80e-310aa003de1c req-191bbacd-c62b-4a2f-a294-90246fee7a9a service nova] Releasing lock "refresh_cache-98005938-a919-41cd-94bb-bfc1c9f7ea04" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:53:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:07 user nova-compute[75260]: INFO nova.compute.manager [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Terminating instance
Nov 27 04:53:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-60241eed-93e3-499e-aa9f-6fb6be0325e5 req-5f72a155-20fa-4a37-b491-33b0d3137a8d service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-unplugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-60241eed-93e3-499e-aa9f-6fb6be0325e5 req-5f72a155-20fa-4a37-b491-33b0d3137a8d service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-60241eed-93e3-499e-aa9f-6fb6be0325e5 req-5f72a155-20fa-4a37-b491-33b0d3137a8d service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-60241eed-93e3-499e-aa9f-6fb6be0325e5 req-5f72a155-20fa-4a37-b491-33b0d3137a8d service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-60241eed-93e3-499e-aa9f-6fb6be0325e5 req-5f72a155-20fa-4a37-b491-33b0d3137a8d service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-unplugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:53:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-60241eed-93e3-499e-aa9f-6fb6be0325e5 req-5f72a155-20fa-4a37-b491-33b0d3137a8d service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-unplugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:53:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Instance destroyed successfully.
Nov 27 04:53:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lazy-loading 'resources' on Instance uuid 57ee8ff0-df13-4f15-96a0-c324b10dd9a7 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1343339764',display_name='tempest-ServerStableDeviceRescueTest-server-1343339764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1343339764',id=23,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTQN+/2CjAEBmT4+S+1zo64Z0W5v1lvMJnT95nxxyeuCKn1YzWu5h2Sgpil050tma7PbOyqmOUnEFI32sPfr1Lq9oY/oSHuA9d3TuhQeiSZENua0tyJQOXqlfYvzCbiAw==',key_name='tempest-keypair-817121387',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:50:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efcdc0a7701245aaae5d18694ec3e0e4',ramdisk_id='',reservation_id='r-1j1jr746',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1298117882',owner_user_name='tempest-ServerStableDeviceRescueTest-1298117882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbc381d6509448db6f2b23ec2a609d2',uuid=57ee8ff0-df13-4f15-96a0-c324b10dd9a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Converting VIF {"id": "08fcec14-f146-4deb-861b-02af609bfd4e", "address": "fa:16:3e:68:c8:81", "network": {"id": "eaa843ad-ee5c-45a7-ad9f-103049904426", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-915824164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efcdc0a7701245aaae5d18694ec3e0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fcec14-f1", "ovs_interfaceid": "08fcec14-f146-4deb-861b-02af609bfd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:c8:81,bridge_name='br-int',has_traffic_filtering=True,id=08fcec14-f146-4deb-861b-02af609bfd4e,network=Network(eaa843ad-ee5c-45a7-ad9f-103049904426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fcec14-f1') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG os_vif [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:c8:81,bridge_name='br-int',has_traffic_filtering=True,id=08fcec14-f146-4deb-861b-02af609bfd4e,network=Network(eaa843ad-ee5c-45a7-ad9f-103049904426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fcec14-f1') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08fcec14-f1, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d49e48eb-1a01-4b8b-aaa8-3d4f89ee476a) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:08 user nova-compute[75260]: INFO os_vif [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:c8:81,bridge_name='br-int',has_traffic_filtering=True,id=08fcec14-f146-4deb-861b-02af609bfd4e,network=Network(eaa843ad-ee5c-45a7-ad9f-103049904426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fcec14-f1')
Nov 27 04:53:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Deleting instance files /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7_del
Nov 27 04:53:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Deletion of /opt/stack/data/nova/instances/57ee8ff0-df13-4f15-96a0-c324b10dd9a7_del complete
Nov 27 04:53:08 user nova-compute[75260]: INFO nova.compute.manager [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 27 04:53:08 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:53:08 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:53:09 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Took 0.79 seconds to deallocate network for instance.
Nov 27 04:53:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-5ef2e41a-6be6-430b-a652-019ced9b5765 req-fdf60a3c-4b15-41ec-9349-578050b016ee service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-deleted-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:09 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Deleted allocations for instance 57ee8ff0-df13-4f15-96a0-c324b10dd9a7
Nov 27 04:53:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-316ce012-a23f-49a0-84b2-f377537b34e0 tempest-ServerStableDeviceRescueTest-1298117882 tempest-ServerStableDeviceRescueTest-1298117882-project-member] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.214s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-a96c11e1-f057-4dd0-aced-2e3f6a88e88d req-aac4a6f1-ee4e-4ded-9775-a0a5f96a8c9d service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a96c11e1-f057-4dd0-aced-2e3f6a88e88d req-aac4a6f1-ee4e-4ded-9775-a0a5f96a8c9d service nova] Acquiring lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a96c11e1-f057-4dd0-aced-2e3f6a88e88d req-aac4a6f1-ee4e-4ded-9775-a0a5f96a8c9d service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a96c11e1-f057-4dd0-aced-2e3f6a88e88d req-aac4a6f1-ee4e-4ded-9775-a0a5f96a8c9d service nova] Lock "57ee8ff0-df13-4f15-96a0-c324b10dd9a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-a96c11e1-f057-4dd0-aced-2e3f6a88e88d req-aac4a6f1-ee4e-4ded-9775-a0a5f96a8c9d service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] No waiting events found dispatching network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:53:09 user nova-compute[75260]: WARNING nova.compute.manager [req-a96c11e1-f057-4dd0-aced-2e3f6a88e88d req-aac4a6f1-ee4e-4ded-9775-a0a5f96a8c9d service nova] [instance: 57ee8ff0-df13-4f15-96a0-c324b10dd9a7] Received unexpected event network-vif-plugged-08fcec14-f146-4deb-861b-02af609bfd4e for instance with vm_state deleted and task_state None.
Nov 27 04:53:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:21 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 is timed out.
Nov 27 04:53:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Successfully detached device vdb from instance 98005938-a919-41cd-94bb-bfc1c9f7ea04 from the live domain config.
Nov 27 04:53:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rMGhcbiJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:53:21 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a58c70d-2b37-4944-9989-4bb6fbeaf99c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:53:21 user nova-compute[75260]: No targets found.
Nov 27 04:53:21 user nova-compute[75260]: iSNS:
Nov 27 04:53:21 user nova-compute[75260]: No targets found.
Nov 27 04:53:21 user nova-compute[75260]: STATIC:
Nov 27 04:53:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:53:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:53:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:53:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9
Nov 27 04:53:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:53:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:53:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168
Nov 27 04:53:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:53:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:53:21 user nova-compute[75260]: FIRMWARE:
Nov 27 04:53:21 user nova-compute[75260]: No targets found.
Nov 27 04:53:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:53:21 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:53:21 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4613bb3e-8fc2-4550-b2fa-f41ca2f2cfff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b697eb37-04ac-445a-b450-1b50bf671816]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:53:21 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:53:21 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:53:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 (non-flash)
Nov 27 04:53:21 user nova-compute[75260]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:53:21 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:53:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c2b55a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ecb82e-f8ce-4685-b6e4-262371efd84c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b407516c-d00c-4bf3-a8a1-d58fdcebe4c8]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a3c39d-56a8-493f-a98e-5fc7c6a83a80]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b921dea7-db62-4cea-a7f9-04f5f5135267]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37917e2-17fb-4a56-a4ad-f04e877dc959]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffd0f38-4a5d-4793-a2a8-49a9f625383d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9, portal: 172.16.0.220,3260]
Nov 27 04:53:21 user nova-compute[75260]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9, portal: 172.16.0.220,3260] successful.
Nov 27 04:53:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4fe2bd-1ed0-4d40-a001-99f5bd1cbdf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[10736b72-77df-4f6b-8b1f-9d62caef2f83]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] <== disconnect_volume: return (304ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:53:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:53:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:22 user nova-compute[75260]: DEBUG nova.objects.instance [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'flavor' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-05046486-560a-4f58-84a8-ed1824bc9e8b tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.638s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:31 user nova-compute[75260]: INFO nova.compute.manager [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Rescuing
Nov 27 04:53:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:53:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquired lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:53:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:53:31 user nova-compute[75260]: DEBUG nova.network.neutron [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updating instance_info_cache with network_info: [{"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:53:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Releasing lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:53:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-0f8a7841-8e48-4ab9-b63c-351f702cf644 req-6babac71-a289-4893-a7bd-a6508c070f3d service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-unplugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f8a7841-8e48-4ab9-b63c-351f702cf644 req-6babac71-a289-4893-a7bd-a6508c070f3d service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f8a7841-8e48-4ab9-b63c-351f702cf644 req-6babac71-a289-4893-a7bd-a6508c070f3d service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0f8a7841-8e48-4ab9-b63c-351f702cf644 req-6babac71-a289-4893-a7bd-a6508c070f3d service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-0f8a7841-8e48-4ab9-b63c-351f702cf644 req-6babac71-a289-4893-a7bd-a6508c070f3d service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-unplugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:53:32 user nova-compute[75260]: WARNING nova.compute.manager [req-0f8a7841-8e48-4ab9-b63c-351f702cf644 req-6babac71-a289-4893-a7bd-a6508c070f3d service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-unplugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state active and task_state rescuing.
Nov 27 04:53:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:32 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Instance destroyed successfully.
Nov 27 04:53:32 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Attempting a stable device rescue
Nov 27 04:53:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75260) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Instance directory exists: not creating {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 04:53:32 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Creating image(s)
Nov 27 04:53:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "/opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "/opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'trusted_certs' on Instance uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "1f97dada6faaeed8012122c9627f65db9d644dab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1f97dada6faaeed8012122c9627f65db9d644dab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab.part --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:33 user nova-compute[75260]: DEBUG nova.virt.images [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] f5055738-917d-47e5-a49d-8dd90d39f148 was qcow2, converting to raw {{(pid=75260) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 04:53:33 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 04:53:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab.part /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab.converted {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG nova.compute.manager [req-b166d120-cc8c-4f8e-a223-e5595e7ce1c9 req-7996120c-01ed-4317-84a6-d1e70fbf9fd1 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b166d120-cc8c-4f8e-a223-e5595e7ce1c9 req-7996120c-01ed-4317-84a6-d1e70fbf9fd1 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b166d120-cc8c-4f8e-a223-e5595e7ce1c9 req-7996120c-01ed-4317-84a6-d1e70fbf9fd1 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b166d120-cc8c-4f8e-a223-e5595e7ce1c9 req-7996120c-01ed-4317-84a6-d1e70fbf9fd1 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG nova.compute.manager [req-b166d120-cc8c-4f8e-a223-e5595e7ce1c9 req-7996120c-01ed-4317-84a6-d1e70fbf9fd1 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:53:34 user nova-compute[75260]: WARNING nova.compute.manager [req-b166d120-cc8c-4f8e-a223-e5595e7ce1c9 req-7996120c-01ed-4317-84a6-d1e70fbf9fd1 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state active and task_state rescuing.
Nov 27 04:53:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab.part /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab.converted" returned: 0 in 0.622s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab.converted --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1f97dada6faaeed8012122c9627f65db9d644dab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.045s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "1f97dada6faaeed8012122c9627f65db9d644dab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1f97dada6faaeed8012122c9627f65db9d644dab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab --force-share --output=json" returned: 0 in 0.202s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab,backing_fmt=raw /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab,backing_fmt=raw /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue" returned: 0 in 0.055s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1f97dada6faaeed8012122c9627f65db9d644dab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'migration_context' on Instance uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.objects.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Object Instance<e7c75f6e-668d-49ec-8bc3-b003b839d205> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Start _get_guest_xml network_info=[{"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "vif_mac": "fa:16:3e:54:34:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f5055738-917d-47e5-a49d-8dd90d39f148', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'af591662-d1cc-474b-9875-84a7c5ef8220', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqgnjUwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'e7c75f6e-668d-49ec-8bc3-b003b839d205', 'attached_at': '', 'detached_at': '', 'volume_id': '01add167-eeb1-4fe2-81c7-32f3d08563ad', 'serial': '01add167-eeb1-4fe2-81c7-32f3d08563ad'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'resources' on Instance uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.objects.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Object Instance<e7c75f6e-668d-49ec-8bc3-b003b839d205> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'numa_topology' on Instance uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.objects.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Object Instance<e7c75f6e-668d-49ec-8bc3-b003b839d205> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:53:35 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:53:35 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.objects.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Object Instance<e7c75f6e-668d-49ec-8bc3-b003b839d205> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqgnjUwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:53:35 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:53:35 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:53:35 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb4a15-2515-472a-acd4-2d8ace96f24f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xqgnjUwF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 27 04:53:35 user nova-compute[75260]: node.name = iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:53:35 user nova-compute[75260]: node.tpgt = -1
Nov 27 04:53:35 user nova-compute[75260]: node.startup = automatic
Nov 27 04:53:35 user nova-compute[75260]: node.leading_login = No
Nov 27 04:53:35 user nova-compute[75260]: iface.iscsi_ifacename = default
Nov 27 04:53:35 user nova-compute[75260]: iface.net_ifacename = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.ipaddress = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.prefix_len = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.hwaddress = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.transport_name = tcp
Nov 27 04:53:35 user nova-compute[75260]: iface.initiatorname = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.state = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.vlan_id = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.vlan_priority = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.vlan_state = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.iface_num = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.mtu = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.port = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.bootproto = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.subnet_mask = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.gateway = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.dhcp_alt_client_id_state = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.dhcp_alt_client_id = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.dhcp_dns = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.dhcp_learn_iqn = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.dhcp_req_vendor_id_state = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.dhcp_vendor_id_state = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.dhcp_vendor_id = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.dhcp_slp_da = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.fragmentation = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.gratuitous_arp = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.incoming_forwarding = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.tos_state = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.tos = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.ttl = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.delayed_ack = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.tcp_nagle = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.tcp_wsf_state = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.tcp_wsf = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.tcp_timer_scale = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.tcp_timestamp = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.redirect = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.def_task_mgmt_timeout = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.header_digest = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.data_digest = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.immediate_data = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.initial_r2t = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.data_seq_inorder = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.data_pdu_inorder = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.erl = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.max_receive_data_len = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.first_burst_len = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.max_outstanding_r2t = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.max_burst_len = 0
Nov 27 04:53:35 user nova-compute[75260]: iface.chap_auth = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.bidi_chap = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.strict_login_compliance = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.discovery_auth = <empty>
Nov 27 04:53:35 user nova-compute[75260]: iface.discovery_logout = <empty>
Nov 27 04:53:35 user nova-compute[75260]: node.discovery_address = <empty>
Nov 27 04:53:35 user nova-compute[75260]: node.discovery_port = 0
Nov 27 04:53:35 user nova-compute[75260]: node.discovery_type = static
Nov 27 04:53:35 user nova-compute[75260]: node.session.initial_cmdsn = 0
Nov 27 04:53:35 user nova-compute[75260]: node.session.initial_login_retry_max = 8
Nov 27 04:53:35 user nova-compute[75260]: node.session.xmit_thread_priority = -20
Nov 27 04:53:35 user nova-compute[75260]: node.session.cmds_max = 128
Nov 27 04:53:35 user nova-compute[75260]: node.session.queue_depth = 32
Nov 27 04:53:35 user nova-compute[75260]: node.session.nr_sessions = 1
Nov 27 04:53:35 user nova-compute[75260]: node.session.auth.authmethod = CHAP
Nov 27 04:53:35 user nova-compute[75260]: node.session.auth.username = xqgnjUwF
Nov 27 04:53:35 user nova-compute[75260]: node.session.auth.password = ***
Nov 27 04:53:35 user nova-compute[75260]: node.session.auth.username_in = <empty>
Nov 27 04:53:35 user nova-compute[75260]: node.session.auth.password_in = <empty>
Nov 27 04:53:35 user nova-compute[75260]: node.session.auth.chap_algs = MD5
Nov 27 04:53:35 user nova-compute[75260]: node.session.timeo.replacement_timeout = 120
Nov 27 04:53:35 user nova-compute[75260]: node.session.err_timeo.abort_timeout = 15
Nov 27 04:53:35 user nova-compute[75260]: node.session.err_timeo.lu_reset_timeout = 30
Nov 27 04:53:35 user nova-compute[75260]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 27 04:53:35 user nova-compute[75260]: node.session.err_timeo.host_reset_timeout = 60
Nov 27 04:53:35 user nova-compute[75260]: node.session.iscsi.FastAbort = Yes
Nov 27 04:53:35 user nova-compute[75260]: node.session.iscsi.InitialR2T = No
Nov 27 04:53:35 user nova-compute[75260]: node.session.iscsi.ImmediateData = Yes
Nov 27 04:53:35 user nova-compute[75260]: node.session.iscsi.FirstBurstLength = 262144
Nov 27 04:53:35 user nova-compute[75260]: node.session.iscsi.MaxBurstLength = 16776192
Nov 27 04:53:35 user nova-compute[75260]: node.session.iscsi.DefaultTime2Retain = 0
Nov 27 04:53:35 user nova-compute[75260]: node.session.iscsi.DefaultTime2Wait = 2
Nov 27 04:53:35 user nova-compute[75260]: node.session.iscsi.MaxConnections = 1
Nov 27 04:53:35 user nova-compute[75260]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 27 04:53:35 user nova-compute[75260]: node.session.iscsi.ERL = 0
Nov 27 04:53:35 user nova-compute[75260]: node.session.scan = manual
Nov 27 04:53:35 user nova-compute[75260]: node.session.reopen_max = 0
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].address = 172.16.0.220
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].port = 3260
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].startup = manual
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].tcp.window_size = 524288
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].tcp.type_of_service = 0
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].timeo.logout_timeout = 15
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].timeo.login_timeout = 15
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].timeo.auth_timeout = 45
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].timeo.noop_out_interval = 5
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].timeo.noop_out_timeout = 5
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].iscsi.HeaderDigest = None
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].iscsi.DataDigest = None
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].iscsi.IFMarker = No
Nov 27 04:53:35 user nova-compute[75260]: node.conn[0].iscsi.OFMarker = No
Nov 27 04:53:35 user nova-compute[75260]: # END RECORD
Nov 27 04:53:35 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3620cbb-bdbf-43e0-982f-f6d917781729]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4833d7db-d72f-46de-b027-5420f4e59baa]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xqgnjUwF {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xqgnjUwF" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3901a1b4-bddb-4dd1-94d6-553333dc1c26]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xqgnjUwF'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7d942d-c93d-4de7-91f4-aa6932c2bfc8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f825843e-f611-4f02-ab51-391a27fd9ba7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:53:35 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:53:35 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:53:35 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:53:35 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.186s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] HCTL ('37', '0', '0', 0) found on session 32 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbcfe4f-2abd-42c5-8228-b199db9f5113]: (4, ('0 0 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching for a device in session 32 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqgnjUwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.215s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] <== connect_volume: return (217ms) {'type': 'block', 'scsi_wwn': '23062316439346165', 'path': '/dev/sdf'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062316439346165', 'path': '/dev/sdf'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-665818185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-665818185',id=31,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-50cm5jfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:51:59Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=e7c75f6e-668d-49ec-8bc3-b003b839d205,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "vif_mac": "fa:16:3e:54:34:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "vif_mac": "fa:16:3e:54:34:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:34:6c,bridge_name='br-int',has_traffic_filtering=True,id=de4a339f-5096-4327-8a9f-16433c75a112,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a339f-50') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'pci_devices' on Instance uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.objects.base [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Object Instance<e7c75f6e-668d-49ec-8bc3-b003b839d205> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:53:35 user nova-compute[75260]:   <uuid>e7c75f6e-668d-49ec-8bc3-b003b839d205</uuid>
Nov 27 04:53:35 user nova-compute[75260]:   <name>instance-0000001f</name>
Nov 27 04:53:35 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:53:35 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:53:35 user nova-compute[75260]:   <metadata>
Nov 27 04:53:35 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:53:35 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:53:35 user nova-compute[75260]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-665818185</nova:name>
Nov 27 04:53:35 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:53:35</nova:creationTime>
Nov 27 04:53:35 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:53:35 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:53:35 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:53:35 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:53:35 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:53:35 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:53:35 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:53:35 user nova-compute[75260]:       <nova:owner>
Nov 27 04:53:35 user nova-compute[75260]:         <nova:user uuid="05cdf3b00bfe4f728e7fa4e17eba3c4e">tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member</nova:user>
Nov 27 04:53:35 user nova-compute[75260]:         <nova:project uuid="7eada319615449deb2152f59ba3d3e6d">tempest-ServerBootFromVolumeStableRescueTest-293744143</nova:project>
Nov 27 04:53:35 user nova-compute[75260]:       </nova:owner>
Nov 27 04:53:35 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:53:35 user nova-compute[75260]:       <nova:ports>
Nov 27 04:53:35 user nova-compute[75260]:         <nova:port uuid="de4a339f-5096-4327-8a9f-16433c75a112">
Nov 27 04:53:35 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 04:53:35 user nova-compute[75260]:         </nova:port>
Nov 27 04:53:35 user nova-compute[75260]:       </nova:ports>
Nov 27 04:53:35 user nova-compute[75260]:     </nova:instance>
Nov 27 04:53:35 user nova-compute[75260]:   </metadata>
Nov 27 04:53:35 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:53:35 user nova-compute[75260]:     <system>
Nov 27 04:53:35 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:53:35 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:53:35 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:53:35 user nova-compute[75260]:       <entry name="serial">e7c75f6e-668d-49ec-8bc3-b003b839d205</entry>
Nov 27 04:53:35 user nova-compute[75260]:       <entry name="uuid">e7c75f6e-668d-49ec-8bc3-b003b839d205</entry>
Nov 27 04:53:35 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:53:35 user nova-compute[75260]:     </system>
Nov 27 04:53:35 user nova-compute[75260]:   </sysinfo>
Nov 27 04:53:35 user nova-compute[75260]:   <os>
Nov 27 04:53:35 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:53:35 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:53:35 user nova-compute[75260]:   </os>
Nov 27 04:53:35 user nova-compute[75260]:   <features>
Nov 27 04:53:35 user nova-compute[75260]:     <acpi/>
Nov 27 04:53:35 user nova-compute[75260]:     <apic/>
Nov 27 04:53:35 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:53:35 user nova-compute[75260]:   </features>
Nov 27 04:53:35 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:53:35 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:53:35 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:53:35 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:53:35 user nova-compute[75260]:   </clock>
Nov 27 04:53:35 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:53:35 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:53:35 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:53:35 user nova-compute[75260]:   </cpu>
Nov 27 04:53:35 user nova-compute[75260]:   <devices>
Nov 27 04:53:35 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:53:35 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:53:35 user nova-compute[75260]:       <source dev="/dev/sdf"/>
Nov 27 04:53:35 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:53:35 user nova-compute[75260]:       <serial>01add167-eeb1-4fe2-81c7-32f3d08563ad</serial>
Nov 27 04:53:35 user nova-compute[75260]:     </disk>
Nov 27 04:53:35 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:53:35 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:53:35 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue"/>
Nov 27 04:53:35 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 04:53:35 user nova-compute[75260]:       <boot order="1"/>
Nov 27 04:53:35 user nova-compute[75260]:     </disk>
Nov 27 04:53:35 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:53:35 user nova-compute[75260]:       <mac address="fa:16:3e:54:34:6c"/>
Nov 27 04:53:35 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:53:35 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:53:35 user nova-compute[75260]:       <target dev="tapde4a339f-50"/>
Nov 27 04:53:35 user nova-compute[75260]:     </interface>
Nov 27 04:53:35 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:53:35 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/console.log" append="off"/>
Nov 27 04:53:35 user nova-compute[75260]:     </serial>
Nov 27 04:53:35 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:53:35 user nova-compute[75260]:     <video>
Nov 27 04:53:35 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:53:35 user nova-compute[75260]:     </video>
Nov 27 04:53:35 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:53:35 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:53:35 user nova-compute[75260]:     </rng>
Nov 27 04:53:35 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:53:35 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:53:35 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:53:35 user nova-compute[75260]:     </memballoon>
Nov 27 04:53:35 user nova-compute[75260]:   </devices>
Nov 27 04:53:35 user nova-compute[75260]: </domain>
Nov 27 04:53:35 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:53:35 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Instance destroyed successfully.
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:53:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No VIF found with MAC fa:16:3e:54:34:6c, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:53:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-c4add0b2-5dad-4573-a951-b72457154520 req-897bc73a-c993-4b87-ba2f-7da3097304a8 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c4add0b2-5dad-4573-a951-b72457154520 req-897bc73a-c993-4b87-ba2f-7da3097304a8 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c4add0b2-5dad-4573-a951-b72457154520 req-897bc73a-c993-4b87-ba2f-7da3097304a8 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c4add0b2-5dad-4573-a951-b72457154520 req-897bc73a-c993-4b87-ba2f-7da3097304a8 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-c4add0b2-5dad-4573-a951-b72457154520 req-897bc73a-c993-4b87-ba2f-7da3097304a8 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:53:37 user nova-compute[75260]: WARNING nova.compute.manager [req-c4add0b2-5dad-4573-a951-b72457154520 req-897bc73a-c993-4b87-ba2f-7da3097304a8 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state active and task_state rescuing.
Nov 27 04:53:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-b7fb9f38-6dd1-4749-824c-7f04de3ddc77 req-cd53e739-3ea8-49f3-9d12-12506063b665 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b7fb9f38-6dd1-4749-824c-7f04de3ddc77 req-cd53e739-3ea8-49f3-9d12-12506063b665 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b7fb9f38-6dd1-4749-824c-7f04de3ddc77 req-cd53e739-3ea8-49f3-9d12-12506063b665 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b7fb9f38-6dd1-4749-824c-7f04de3ddc77 req-cd53e739-3ea8-49f3-9d12-12506063b665 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-b7fb9f38-6dd1-4749-824c-7f04de3ddc77 req-cd53e739-3ea8-49f3-9d12-12506063b665 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:53:39 user nova-compute[75260]: WARNING nova.compute.manager [req-b7fb9f38-6dd1-4749-824c-7f04de3ddc77 req-cd53e739-3ea8-49f3-9d12-12506063b665 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state active and task_state rescuing.
Nov 27 04:53:39 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8a32f187-8ee3-450e-a62b-9240afa8937c tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:53:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:50 user nova-compute[75260]: INFO nova.compute.manager [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Terminating instance
Nov 27 04:53:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:53:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-46c680aa-65ff-48da-a4d8-e8207de4c438 req-5759ffb4-376b-4f11-bcde-370016a87a05 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-unplugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-46c680aa-65ff-48da-a4d8-e8207de4c438 req-5759ffb4-376b-4f11-bcde-370016a87a05 service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-46c680aa-65ff-48da-a4d8-e8207de4c438 req-5759ffb4-376b-4f11-bcde-370016a87a05 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-46c680aa-65ff-48da-a4d8-e8207de4c438 req-5759ffb4-376b-4f11-bcde-370016a87a05 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-46c680aa-65ff-48da-a4d8-e8207de4c438 req-5759ffb4-376b-4f11-bcde-370016a87a05 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-unplugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-46c680aa-65ff-48da-a4d8-e8207de4c438 req-5759ffb4-376b-4f11-bcde-370016a87a05 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-unplugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Instance destroyed successfully.
Nov 27 04:53:51 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'resources' on Instance uuid 98005938-a919-41cd-94bb-bfc1c9f7ea04 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1800352952',display_name='tempest-ServerRescueNegativeTestJSON-server-1800352952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1800352952',id=25,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8+BTyfT3yhS/SbL6jWb2kqJSpemmWm+PhfuKA4OHRNL+O4piNSG2X5iPQjpz6riZ0IGRQbpghMSwbrA7MzmD26qCd+NSHWkwJtq4585JE9pls2BftHOx/1bQv4gHdvlg==',key_name='tempest-keypair-404684156',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-gqbk6o4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=98005938-a919-41cd-94bb-bfc1c9f7ea04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "e8622473-aed7-41ef-923e-b8565a6783c2", "address": "fa:16:3e:06:b3:7b", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8622473-ae", "ovs_interfaceid": "e8622473-aed7-41ef-923e-b8565a6783c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:b3:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8622473-aed7-41ef-923e-b8565a6783c2,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8622473-ae') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG os_vif [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:b3:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8622473-aed7-41ef-923e-b8565a6783c2,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8622473-ae') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8622473-ae, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f98febd-2920-451e-b363-a305ad62c7c1) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:53:51 user nova-compute[75260]: INFO os_vif [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:b3:7b,bridge_name='br-int',has_traffic_filtering=True,id=e8622473-aed7-41ef-923e-b8565a6783c2,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8622473-ae')
Nov 27 04:53:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Deleting instance files /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04_del
Nov 27 04:53:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Deletion of /opt/stack/data/nova/instances/98005938-a919-41cd-94bb-bfc1c9f7ea04_del complete
Nov 27 04:53:51 user nova-compute[75260]: INFO nova.compute.manager [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 27 04:53:51 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:53:51 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:53:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:52 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:53:53 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Took 1.16 seconds to deallocate network for instance.
Nov 27 04:53:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-178bb928-d227-4135-9a31-ace1027f2864 req-2629b771-b566-42bf-848a-e658752cdade service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-deleted-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-faf2547a-5855-4469-829d-e144ea7a4420 req-8369d72b-f414-42cf-8d48-a646f5d8ae37 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-faf2547a-5855-4469-829d-e144ea7a4420 req-8369d72b-f414-42cf-8d48-a646f5d8ae37 service nova] Acquiring lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-faf2547a-5855-4469-829d-e144ea7a4420 req-8369d72b-f414-42cf-8d48-a646f5d8ae37 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-faf2547a-5855-4469-829d-e144ea7a4420 req-8369d72b-f414-42cf-8d48-a646f5d8ae37 service nova] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-faf2547a-5855-4469-829d-e144ea7a4420 req-8369d72b-f414-42cf-8d48-a646f5d8ae37 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] No waiting events found dispatching network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:53:53 user nova-compute[75260]: WARNING nova.compute.manager [req-faf2547a-5855-4469-829d-e144ea7a4420 req-8369d72b-f414-42cf-8d48-a646f5d8ae37 service nova] [instance: 98005938-a919-41cd-94bb-bfc1c9f7ea04] Received unexpected event network-vif-plugged-e8622473-aed7-41ef-923e-b8565a6783c2 for instance with vm_state deleted and task_state None.
Nov 27 04:53:53 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:53 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Deleted allocations for instance 98005938-a919-41cd-94bb-bfc1c9f7ea04
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "de5b91ae-2b73-4620-93b7-73195724e610" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "de5b91ae-2b73-4620-93b7-73195724e610" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f8aa74db-9991-4d08-beb8-1855f8f1deed tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "98005938-a919-41cd-94bb-bfc1c9f7ea04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.789s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:53:53 user nova-compute[75260]: INFO nova.compute.claims [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Claim successful on node user
Nov 27 04:53:54 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG nova.network.neutron [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:53:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:53:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG nova.policy [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47c5ef7ba8434a4797330f38f74439f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0696f0dfdd40db9b5e8b9aa6397ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:53:54 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Creating image(s)
Nov 27 04:53:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "/opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "/opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "/opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.188s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.206s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Successfully created port: db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk 1073741824" returned: 0 in 0.069s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Cannot resize image /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Ensure instance console log exists: /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Successfully updated port: db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "refresh_cache-de5b91ae-2b73-4620-93b7-73195724e610" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquired lock "refresh_cache-de5b91ae-2b73-4620-93b7-73195724e610" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-d8c35980-4d35-47b1-8d5f-eda9d3ea108f req-87040c27-639e-4380-962f-d400579abfa5 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Received event network-changed-db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-d8c35980-4d35-47b1-8d5f-eda9d3ea108f req-87040c27-639e-4380-962f-d400579abfa5 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Refreshing instance network info cache due to event network-changed-db7ad84a-4118-4bf9-8682-65838684c9e2. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:53:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d8c35980-4d35-47b1-8d5f-eda9d3ea108f req-87040c27-639e-4380-962f-d400579abfa5 service nova] Acquiring lock "refresh_cache-de5b91ae-2b73-4620-93b7-73195724e610" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.network.neutron [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.network.neutron [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Updating instance_info_cache with network_info: [{"id": "db7ad84a-4118-4bf9-8682-65838684c9e2", "address": "fa:16:3e:e6:ef:71", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7ad84a-41", "ovs_interfaceid": "db7ad84a-4118-4bf9-8682-65838684c9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Releasing lock "refresh_cache-de5b91ae-2b73-4620-93b7-73195724e610" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Instance network_info: |[{"id": "db7ad84a-4118-4bf9-8682-65838684c9e2", "address": "fa:16:3e:e6:ef:71", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7ad84a-41", "ovs_interfaceid": "db7ad84a-4118-4bf9-8682-65838684c9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d8c35980-4d35-47b1-8d5f-eda9d3ea108f req-87040c27-639e-4380-962f-d400579abfa5 service nova] Acquired lock "refresh_cache-de5b91ae-2b73-4620-93b7-73195724e610" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-d8c35980-4d35-47b1-8d5f-eda9d3ea108f req-87040c27-639e-4380-962f-d400579abfa5 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Refreshing network info cache for port db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Start _get_guest_xml network_info=[{"id": "db7ad84a-4118-4bf9-8682-65838684c9e2", "address": "fa:16:3e:e6:ef:71", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7ad84a-41", "ovs_interfaceid": "db7ad84a-4118-4bf9-8682-65838684c9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:53:56 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:53:56 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1860006207',display_name='tempest-VolumesActionsTest-instance-1860006207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1860006207',id=33,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b0696f0dfdd40db9b5e8b9aa6397ab7',ramdisk_id='',reservation_id='r-06bykopc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1777164428',owner_user_name='tempest-VolumesActionsTest-1777164428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:53:55Z,user_data=None,user_id='47c5ef7ba8434a4797330f38f74439f6',uuid=de5b91ae-2b73-4620-93b7-73195724e610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db7ad84a-4118-4bf9-8682-65838684c9e2", "address": "fa:16:3e:e6:ef:71", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7ad84a-41", "ovs_interfaceid": "db7ad84a-4118-4bf9-8682-65838684c9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converting VIF {"id": "db7ad84a-4118-4bf9-8682-65838684c9e2", "address": "fa:16:3e:e6:ef:71", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7ad84a-41", "ovs_interfaceid": "db7ad84a-4118-4bf9-8682-65838684c9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=db7ad84a-4118-4bf9-8682-65838684c9e2,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7ad84a-41') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.objects.instance [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lazy-loading 'pci_devices' on Instance uuid de5b91ae-2b73-4620-93b7-73195724e610 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:53:56 user nova-compute[75260]:   <uuid>de5b91ae-2b73-4620-93b7-73195724e610</uuid>
Nov 27 04:53:56 user nova-compute[75260]:   <name>instance-00000021</name>
Nov 27 04:53:56 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:53:56 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:53:56 user nova-compute[75260]:   <metadata>
Nov 27 04:53:56 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:53:56 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:53:56 user nova-compute[75260]:       <nova:name>tempest-VolumesActionsTest-instance-1860006207</nova:name>
Nov 27 04:53:56 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:53:56</nova:creationTime>
Nov 27 04:53:56 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:53:56 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:53:56 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:53:56 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:53:56 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:53:56 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:53:56 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:53:56 user nova-compute[75260]:       <nova:owner>
Nov 27 04:53:56 user nova-compute[75260]:         <nova:user uuid="47c5ef7ba8434a4797330f38f74439f6">tempest-VolumesActionsTest-1777164428-project-member</nova:user>
Nov 27 04:53:56 user nova-compute[75260]:         <nova:project uuid="4b0696f0dfdd40db9b5e8b9aa6397ab7">tempest-VolumesActionsTest-1777164428</nova:project>
Nov 27 04:53:56 user nova-compute[75260]:       </nova:owner>
Nov 27 04:53:56 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:53:56 user nova-compute[75260]:       <nova:ports>
Nov 27 04:53:56 user nova-compute[75260]:         <nova:port uuid="db7ad84a-4118-4bf9-8682-65838684c9e2">
Nov 27 04:53:56 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 04:53:56 user nova-compute[75260]:         </nova:port>
Nov 27 04:53:56 user nova-compute[75260]:       </nova:ports>
Nov 27 04:53:56 user nova-compute[75260]:     </nova:instance>
Nov 27 04:53:56 user nova-compute[75260]:   </metadata>
Nov 27 04:53:56 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:53:56 user nova-compute[75260]:     <system>
Nov 27 04:53:56 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:53:56 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:53:56 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:53:56 user nova-compute[75260]:       <entry name="serial">de5b91ae-2b73-4620-93b7-73195724e610</entry>
Nov 27 04:53:56 user nova-compute[75260]:       <entry name="uuid">de5b91ae-2b73-4620-93b7-73195724e610</entry>
Nov 27 04:53:56 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:53:56 user nova-compute[75260]:     </system>
Nov 27 04:53:56 user nova-compute[75260]:   </sysinfo>
Nov 27 04:53:56 user nova-compute[75260]:   <os>
Nov 27 04:53:56 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:53:56 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:53:56 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:53:56 user nova-compute[75260]:   </os>
Nov 27 04:53:56 user nova-compute[75260]:   <features>
Nov 27 04:53:56 user nova-compute[75260]:     <acpi/>
Nov 27 04:53:56 user nova-compute[75260]:     <apic/>
Nov 27 04:53:56 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:53:56 user nova-compute[75260]:   </features>
Nov 27 04:53:56 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:53:56 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:53:56 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:53:56 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:53:56 user nova-compute[75260]:   </clock>
Nov 27 04:53:56 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:53:56 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:53:56 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:53:56 user nova-compute[75260]:   </cpu>
Nov 27 04:53:56 user nova-compute[75260]:   <devices>
Nov 27 04:53:56 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:53:56 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:53:56 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk"/>
Nov 27 04:53:56 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:53:56 user nova-compute[75260]:     </disk>
Nov 27 04:53:56 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:53:56 user nova-compute[75260]:       <mac address="fa:16:3e:e6:ef:71"/>
Nov 27 04:53:56 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:53:56 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:53:56 user nova-compute[75260]:       <target dev="tapdb7ad84a-41"/>
Nov 27 04:53:56 user nova-compute[75260]:     </interface>
Nov 27 04:53:56 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:53:56 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/console.log" append="off"/>
Nov 27 04:53:56 user nova-compute[75260]:     </serial>
Nov 27 04:53:56 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:53:56 user nova-compute[75260]:     <video>
Nov 27 04:53:56 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:53:56 user nova-compute[75260]:     </video>
Nov 27 04:53:56 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:53:56 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:53:56 user nova-compute[75260]:     </rng>
Nov 27 04:53:56 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:53:56 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:53:56 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:53:56 user nova-compute[75260]:     </memballoon>
Nov 27 04:53:56 user nova-compute[75260]:   </devices>
Nov 27 04:53:56 user nova-compute[75260]: </domain>
Nov 27 04:53:56 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1860006207',display_name='tempest-VolumesActionsTest-instance-1860006207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1860006207',id=33,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b0696f0dfdd40db9b5e8b9aa6397ab7',ramdisk_id='',reservation_id='r-06bykopc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1777164428',owner_user_name='tempest-VolumesActionsTest-1777164428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:53:55Z,user_data=None,user_id='47c5ef7ba8434a4797330f38f74439f6',uuid=de5b91ae-2b73-4620-93b7-73195724e610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db7ad84a-4118-4bf9-8682-65838684c9e2", "address": "fa:16:3e:e6:ef:71", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7ad84a-41", "ovs_interfaceid": "db7ad84a-4118-4bf9-8682-65838684c9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converting VIF {"id": "db7ad84a-4118-4bf9-8682-65838684c9e2", "address": "fa:16:3e:e6:ef:71", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7ad84a-41", "ovs_interfaceid": "db7ad84a-4118-4bf9-8682-65838684c9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=db7ad84a-4118-4bf9-8682-65838684c9e2,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7ad84a-41') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG os_vif [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=db7ad84a-4118-4bf9-8682-65838684c9e2,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7ad84a-41') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ee0f6c8-1076-5bc6-bdd3-c5f070609eb9', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb7ad84a-41, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb7ad84a-41, col_values=(('qos', UUID('fab601b1-7b1e-45c2-9442-da1cd0d7f096')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb7ad84a-41, col_values=(('external_ids', {'iface-id': 'db7ad84a-4118-4bf9-8682-65838684c9e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:ef:71', 'vm-uuid': 'de5b91ae-2b73-4620-93b7-73195724e610'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:56 user nova-compute[75260]: INFO os_vif [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=db7ad84a-4118-4bf9-8682-65838684c9e2,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7ad84a-41')
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] No VIF found with MAC fa:16:3e:e6:ef:71, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-d8c35980-4d35-47b1-8d5f-eda9d3ea108f req-87040c27-639e-4380-962f-d400579abfa5 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Updated VIF entry in instance network info cache for port db7ad84a-4118-4bf9-8682-65838684c9e2. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-d8c35980-4d35-47b1-8d5f-eda9d3ea108f req-87040c27-639e-4380-962f-d400579abfa5 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Updating instance_info_cache with network_info: [{"id": "db7ad84a-4118-4bf9-8682-65838684c9e2", "address": "fa:16:3e:e6:ef:71", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7ad84a-41", "ovs_interfaceid": "db7ad84a-4118-4bf9-8682-65838684c9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d8c35980-4d35-47b1-8d5f-eda9d3ea108f req-87040c27-639e-4380-962f-d400579abfa5 service nova] Releasing lock "refresh_cache-de5b91ae-2b73-4620-93b7-73195724e610" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-eb4d829c-643a-4331-880c-92c94991aaac req-105cf1fe-55da-4d76-9b02-43e252549b37 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received event network-changed-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-eb4d829c-643a-4331-880c-92c94991aaac req-105cf1fe-55da-4d76-9b02-43e252549b37 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Refreshing instance network info cache due to event network-changed-abea12ed-6f73-4322-a892-6c29383eaece. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eb4d829c-643a-4331-880c-92c94991aaac req-105cf1fe-55da-4d76-9b02-43e252549b37 service nova] Acquiring lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eb4d829c-643a-4331-880c-92c94991aaac req-105cf1fe-55da-4d76-9b02-43e252549b37 service nova] Acquired lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:53:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-eb4d829c-643a-4331-880c-92c94991aaac req-105cf1fe-55da-4d76-9b02-43e252549b37 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Refreshing network info cache for port abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-eb4d829c-643a-4331-880c-92c94991aaac req-105cf1fe-55da-4d76-9b02-43e252549b37 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Updated VIF entry in instance network info cache for port abea12ed-6f73-4322-a892-6c29383eaece. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-eb4d829c-643a-4331-880c-92c94991aaac req-105cf1fe-55da-4d76-9b02-43e252549b37 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Updating instance_info_cache with network_info: [{"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eb4d829c-643a-4331-880c-92c94991aaac req-105cf1fe-55da-4d76-9b02-43e252549b37 service nova] Releasing lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG nova.objects.instance [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lazy-loading 'flavor' on Instance uuid f29594ea-2a52-48ac-acfd-66e16dea9dfd {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.210s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:57 user nova-compute[75260]: INFO nova.compute.manager [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Attaching volume 226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 to /dev/vdb
Nov 27 04:53:57 user nova-compute[75260]: DEBUG os_brick.utils [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eed9733-41a9-42c8-b9c6-804228dadf0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c55e3ea-2750-4069-ab3f-8f94bfa8f34d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[be540b05-aa12-44de-8a0e-97dc008111a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[31593fa5-4de1-45ca-b83e-4d2091c3d9ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:53:58 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:53:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[012ab059-5184-4b74-8a99-c4dbf2bd3950]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG os_brick.utils [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Updating existing volume attachment record: 9945330b-bb0d-4f3f-a9da-6592952469c2 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-9e9f9ed9-95e8-41b7-b223-1b7cb85cd3ab req-1d52c143-d259-4882-b055-816bc2948675 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Received event network-vif-plugged-db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9e9f9ed9-95e8-41b7-b223-1b7cb85cd3ab req-1d52c143-d259-4882-b055-816bc2948675 service nova] Acquiring lock "de5b91ae-2b73-4620-93b7-73195724e610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9e9f9ed9-95e8-41b7-b223-1b7cb85cd3ab req-1d52c143-d259-4882-b055-816bc2948675 service nova] Lock "de5b91ae-2b73-4620-93b7-73195724e610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9e9f9ed9-95e8-41b7-b223-1b7cb85cd3ab req-1d52c143-d259-4882-b055-816bc2948675 service nova] Lock "de5b91ae-2b73-4620-93b7-73195724e610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-9e9f9ed9-95e8-41b7-b223-1b7cb85cd3ab req-1d52c143-d259-4882-b055-816bc2948675 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] No waiting events found dispatching network-vif-plugged-db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:53:58 user nova-compute[75260]: WARNING nova.compute.manager [req-9e9f9ed9-95e8-41b7-b223-1b7cb85cd3ab req-1d52c143-d259-4882-b055-816bc2948675 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Received unexpected event network-vif-plugged-db7ad84a-4118-4bf9-8682-65838684c9e2 for instance with vm_state building and task_state spawning.
Nov 27 04:53:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:53:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:53:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:53:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:53:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:53:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:53:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:54:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Instance spawned successfully.
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:54:00 user nova-compute[75260]: INFO nova.compute.manager [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updating instance_info_cache with network_info: [{"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:00 user nova-compute[75260]: INFO nova.compute.manager [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Took 6.55 seconds to build instance.
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-12f00db7-057d-4c97-b751-cafac6f90ba4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "de5b91ae-2b73-4620-93b7-73195724e610" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.816s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-9e4f6a29-2ec5-4bde-a969-ed721ac41ac9 req-6d24170e-68a8-4c8b-af8c-6191c6bf3d5c service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Received event network-vif-plugged-db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9e4f6a29-2ec5-4bde-a969-ed721ac41ac9 req-6d24170e-68a8-4c8b-af8c-6191c6bf3d5c service nova] Acquiring lock "de5b91ae-2b73-4620-93b7-73195724e610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9e4f6a29-2ec5-4bde-a969-ed721ac41ac9 req-6d24170e-68a8-4c8b-af8c-6191c6bf3d5c service nova] Lock "de5b91ae-2b73-4620-93b7-73195724e610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9e4f6a29-2ec5-4bde-a969-ed721ac41ac9 req-6d24170e-68a8-4c8b-af8c-6191c6bf3d5c service nova] Lock "de5b91ae-2b73-4620-93b7-73195724e610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-9e4f6a29-2ec5-4bde-a969-ed721ac41ac9 req-6d24170e-68a8-4c8b-af8c-6191c6bf3d5c service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] No waiting events found dispatching network-vif-plugged-db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:54:00 user nova-compute[75260]: WARNING nova.compute.manager [req-9e4f6a29-2ec5-4bde-a969-ed721ac41ac9 req-6d24170e-68a8-4c8b-af8c-6191c6bf3d5c service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Received unexpected event network-vif-plugged-db7ad84a-4118-4bf9-8682-65838684c9e2 for instance with vm_state active and task_state None.
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:05 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:54:05 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7868MB free_disk=25.1812744140625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance f29594ea-2a52-48ac-acfd-66e16dea9dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance de5b91ae-2b73-4620-93b7-73195724e610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:54:05 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:54:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:54:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:54:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KusRyxqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:54:11 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:54:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:54:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:54:11 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:54:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:54:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:54:11 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:54:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260" returned: 21 in 0.070s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[53af5b12-d5b3-4b5f-aef9-86e625fa4d0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:54:11 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[255e5d72-8255-4333-9b41-faeca1e24ace]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62] added
Nov 27 04:54:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[464889b1-256e-40f9-8e25-20305c47a3e4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc5ca41-6e0f-42b4-a83b-7569540085b2]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KusRyxqL {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KusRyxqL" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[767e97d3-785d-4d24-8286-1c21d8f1d939]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KusRyxqL'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47efbd7-9712-45fc-bedb-4ad0fa4cd750]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6b343b-b4a8-4f2b-aba8-26e69468bb8e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:54:12 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:54:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:54:12 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:54:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c750a-fcad-4416-910f-7b02d7f49dff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62, portal: 172.16.0.220,3260]
Nov 27 04:54:12 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62, portal: 172.16.0.220,3260] successful.
Nov 27 04:54:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e740823b-19ac-4705-8ec6-b8aafadb1f1a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b772c33f-6163-49ac-baac-bfdf6e59615f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:54:12 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:54:12 user nova-compute[75260]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 (non-flash)
Nov 27 04:54:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:54:12 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:54:12 user nova-compute[75260]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 (non-flash)
Nov 27 04:54:12 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b09776-bdf2-402f-b9fb-3f725dd6f0f7]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:54:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KusRyxqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:54:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:54:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23036623764323131', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:54:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036623764323131', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:54:13 user nova-compute[75260]: DEBUG nova.objects.instance [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lazy-loading 'flavor' on Instance uuid f29594ea-2a52-48ac-acfd-66e16dea9dfd {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:54:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:54:13 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:54:13 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:54:13 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:54:13 user nova-compute[75260]:   <serial>226c0b2b-405a-4b7e-b98e-3f2db4ee9c62</serial>
Nov 27 04:54:13 user nova-compute[75260]: </disk>
Nov 27 04:54:13 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:54:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:54:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:54:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] No VIF found with MAC fa:16:3e:91:84:60, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:54:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-744a2749-081f-4e8b-8d1d-f05653060dc5 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.207s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:16 user nova-compute[75260]: INFO nova.compute.manager [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Detaching volume 226c0b2b-405a-4b7e-b98e-3f2db4ee9c62
Nov 27 04:54:16 user nova-compute[75260]: INFO nova.virt.block_device [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Attempting to driver detach volume 226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 from mountpoint /dev/vdb
Nov 27 04:54:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Attempting to detach device vdb from instance f29594ea-2a52-48ac-acfd-66e16dea9dfd from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:54:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:54:16 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:54:16 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:54:16 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:54:16 user nova-compute[75260]:   <serial>226c0b2b-405a-4b7e-b98e-3f2db4ee9c62</serial>
Nov 27 04:54:16 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:54:16 user nova-compute[75260]: </disk>
Nov 27 04:54:16 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:54:16 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Successfully detached device vdb from instance f29594ea-2a52-48ac-acfd-66e16dea9dfd from the persistent domain config.
Nov 27 04:54:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f29594ea-2a52-48ac-acfd-66e16dea9dfd from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:54:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:54:16 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:54:16 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:54:16 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:54:16 user nova-compute[75260]:   <serial>226c0b2b-405a-4b7e-b98e-3f2db4ee9c62</serial>
Nov 27 04:54:16 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:54:16 user nova-compute[75260]: </disk>
Nov 27 04:54:16 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:54:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f29594ea-2a52-48ac-acfd-66e16dea9dfd {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:54:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:35 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:36 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f29594ea-2a52-48ac-acfd-66e16dea9dfd is timed out.
Nov 27 04:54:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Successfully detached device vdb from instance f29594ea-2a52-48ac-acfd-66e16dea9dfd from the live domain config.
Nov 27 04:54:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KusRyxqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:54:36 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:54:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc20d245-3e66-4671-a2d0-90f111de1aae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:54:36 user nova-compute[75260]: No targets found.
Nov 27 04:54:36 user nova-compute[75260]: iSNS:
Nov 27 04:54:36 user nova-compute[75260]: No targets found.
Nov 27 04:54:36 user nova-compute[75260]: STATIC:
Nov 27 04:54:36 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:54:36 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:54:36 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:54:36 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62
Nov 27 04:54:36 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:54:36 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:54:36 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168
Nov 27 04:54:36 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:54:36 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:54:36 user nova-compute[75260]: FIRMWARE:
Nov 27 04:54:36 user nova-compute[75260]: No targets found.
Nov 27 04:54:36 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:54:36 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:54:36 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4efbe01-fc2d-41c8-8aa0-fe72d14967f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abaf1f3-ccec-42de-86ae-980729fcbbdd]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:54:36 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:54:36 user nova-compute[75260]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 (non-flash)
Nov 27 04:54:36 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:54:36 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:54:36 user nova-compute[75260]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 (non-flash)
Nov 27 04:54:36 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c211f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:54:36 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1252f1-dae9-4e95-bb60-77bf7f0ada50]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b41229-ca29-4570-9f5d-ca284d62657a]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[677488b1-263b-44e1-ad9d-284c9a3876a4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3754977d-1eab-47e5-b8ac-ef6f837dd254]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf27ea95-8616-4dab-a2d0-2c740a5461fc]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b555fccf-1e3a-46fa-b82c-487ff28ac333]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62, portal: 172.16.0.220,3260]
Nov 27 04:54:37 user nova-compute[75260]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62, portal: 172.16.0.220,3260] successful.
Nov 27 04:54:37 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226c0b2b-405a-4b7e-b98e-3f2db4ee9c62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc94f963-5c15-400e-947b-eefb61e5c901]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] <== disconnect_volume: return (323ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:54:37 user nova-compute[75260]: DEBUG nova.objects.instance [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lazy-loading 'flavor' on Instance uuid f29594ea-2a52-48ac-acfd-66e16dea9dfd {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:54:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a0fe8eea-ef91-44f0-bfc7-aeb0c8761c3a tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.717s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:49 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:49 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:50 user nova-compute[75260]: INFO nova.compute.manager [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Terminating instance
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-6cc148a5-b2c4-431c-aa30-e845d9150521 req-97adbc86-7778-45f2-9e8f-ca64bd94aec8 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-vif-unplugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6cc148a5-b2c4-431c-aa30-e845d9150521 req-97adbc86-7778-45f2-9e8f-ca64bd94aec8 service nova] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6cc148a5-b2c4-431c-aa30-e845d9150521 req-97adbc86-7778-45f2-9e8f-ca64bd94aec8 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6cc148a5-b2c4-431c-aa30-e845d9150521 req-97adbc86-7778-45f2-9e8f-ca64bd94aec8 service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-6cc148a5-b2c4-431c-aa30-e845d9150521 req-97adbc86-7778-45f2-9e8f-ca64bd94aec8 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] No waiting events found dispatching network-vif-unplugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-6cc148a5-b2c4-431c-aa30-e845d9150521 req-97adbc86-7778-45f2-9e8f-ca64bd94aec8 service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-vif-unplugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Instance destroyed successfully.
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.objects.instance [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'resources' on Instance uuid d8cd1732-d408-4ef3-85b6-94b12ba7f5ad {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-802958880',display_name='tempest-ServerRescueNegativeTestJSON-server-802958880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-802958880',id=2,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:40:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-hpfh43sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:40:41Z,user_data=None,user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=d8cd1732-d408-4ef3-85b6-94b12ba7f5ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "address": "fa:16:3e:b1:85:32", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba9a12f-82", "ovs_interfaceid": "3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:85:32,bridge_name='br-int',has_traffic_filtering=True,id=3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9a12f-82') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG os_vif [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:85:32,bridge_name='br-int',has_traffic_filtering=True,id=3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9a12f-82') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ba9a12f-82, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updating instance_info_cache with network_info: [{"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54d517b9-1e65-420c-b62e-a593f7229a99) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:50 user nova-compute[75260]: INFO os_vif [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:85:32,bridge_name='br-int',has_traffic_filtering=True,id=3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba9a12f-82')
Nov 27 04:54:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Deleting instance files /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad_del
Nov 27 04:54:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Deletion of /opt/stack/data/nova/instances/d8cd1732-d408-4ef3-85b6-94b12ba7f5ad_del complete
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:54:50 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:51 user nova-compute[75260]: INFO nova.compute.manager [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 27 04:54:51 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:54:51 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:54:51 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:54:51 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:54:51 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Took 0.55 seconds to deallocate network for instance.
Nov 27 04:54:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:51 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:51 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:51 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:52 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Deleted allocations for instance d8cd1732-d408-4ef3-85b6-94b12ba7f5ad
Nov 27 04:54:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7aa9be18-d8a2-4fa4-a5ac-b2a1d25cb665 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.230s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-511064af-113f-4315-828d-22bc47e1f882 req-690ec878-6802-4e67-b923-480ebe9d082d service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-511064af-113f-4315-828d-22bc47e1f882 req-690ec878-6802-4e67-b923-480ebe9d082d service nova] Acquiring lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-511064af-113f-4315-828d-22bc47e1f882 req-690ec878-6802-4e67-b923-480ebe9d082d service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-511064af-113f-4315-828d-22bc47e1f882 req-690ec878-6802-4e67-b923-480ebe9d082d service nova] Lock "d8cd1732-d408-4ef3-85b6-94b12ba7f5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-511064af-113f-4315-828d-22bc47e1f882 req-690ec878-6802-4e67-b923-480ebe9d082d service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] No waiting events found dispatching network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:54:52 user nova-compute[75260]: WARNING nova.compute.manager [req-511064af-113f-4315-828d-22bc47e1f882 req-690ec878-6802-4e67-b923-480ebe9d082d service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received unexpected event network-vif-plugged-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e for instance with vm_state deleted and task_state None.
Nov 27 04:54:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-511064af-113f-4315-828d-22bc47e1f882 req-690ec878-6802-4e67-b923-480ebe9d082d service nova] [instance: d8cd1732-d408-4ef3-85b6-94b12ba7f5ad] Received event network-vif-deleted-3ba9a12f-8236-4cb2-a1ec-4baeb1b5886e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:54:53 user nova-compute[75260]: INFO nova.compute.claims [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Claim successful on node user
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Refreshing inventories for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Updating ProviderTree inventory for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Refreshing aggregate associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, aggregates: None {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Refreshing trait associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:54:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75260) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.policy [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cea49459be634b3bb4646f78b9c2798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb59aff3328844a5b259f5a44e7bb574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:54:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Creating image(s)
Nov 27 04:54:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "/opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "/opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "/opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk 1073741824" returned: 0 in 0.055s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.244s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG nova.network.neutron [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Successfully created port: 644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Cannot resize image /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Ensure instance console log exists: /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Successfully updated port: 644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "refresh_cache-49bed705-0bcf-41aa-9acc-a8117d4d47b0" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquired lock "refresh_cache-49bed705-0bcf-41aa-9acc-a8117d4d47b0" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-7389aefb-683b-4fc7-9ce8-f75206973d9a req-4fb4bb14-483c-491a-898e-fbb534fae8d3 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-changed-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-7389aefb-683b-4fc7-9ce8-f75206973d9a req-4fb4bb14-483c-491a-898e-fbb534fae8d3 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Refreshing instance network info cache due to event network-changed-644a8370-b874-4106-afb9-751704c5e737. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7389aefb-683b-4fc7-9ce8-f75206973d9a req-4fb4bb14-483c-491a-898e-fbb534fae8d3 service nova] Acquiring lock "refresh_cache-49bed705-0bcf-41aa-9acc-a8117d4d47b0" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.network.neutron [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Updating instance_info_cache with network_info: [{"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Releasing lock "refresh_cache-49bed705-0bcf-41aa-9acc-a8117d4d47b0" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Instance network_info: |[{"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7389aefb-683b-4fc7-9ce8-f75206973d9a req-4fb4bb14-483c-491a-898e-fbb534fae8d3 service nova] Acquired lock "refresh_cache-49bed705-0bcf-41aa-9acc-a8117d4d47b0" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-7389aefb-683b-4fc7-9ce8-f75206973d9a req-4fb4bb14-483c-491a-898e-fbb534fae8d3 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Refreshing network info cache for port 644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Start _get_guest_xml network_info=[{"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:54:56 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:54:56 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1106648627',display_name='tempest-TestServerVolumeAttachmentScenario-server-1106648627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1106648627',id=34,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4dLAUmgCK8xsk+8hhhcJisYuJXmVkh9syMfzC+cbgie9XD3WDlZ1aHKkY8izXMMF+20hzoDhzYKTlXIM0/E9M1uURyq8Ca5i9n1NhF2Ad53iYQnrbrmmh1kgmWAsxncw==',key_name='tempest-keypair-1275059708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb59aff3328844a5b259f5a44e7bb574',ramdisk_id='',reservation_id='r-5t3ugpr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1407041504',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1407041504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea49459be634b3bb4646f78b9c2798f',uuid=49bed705-0bcf-41aa-9acc-a8117d4d47b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Converting VIF {"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:af:22,bridge_name='br-int',has_traffic_filtering=True,id=644a8370-b874-4106-afb9-751704c5e737,network=Network(d2f1b28f-1bde-474a-b6d7-62bdafb1b89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644a8370-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.objects.instance [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lazy-loading 'pci_devices' on Instance uuid 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:54:56 user nova-compute[75260]:   <uuid>49bed705-0bcf-41aa-9acc-a8117d4d47b0</uuid>
Nov 27 04:54:56 user nova-compute[75260]:   <name>instance-00000022</name>
Nov 27 04:54:56 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:54:56 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:54:56 user nova-compute[75260]:   <metadata>
Nov 27 04:54:56 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:54:56 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:54:56 user nova-compute[75260]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1106648627</nova:name>
Nov 27 04:54:56 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:54:56</nova:creationTime>
Nov 27 04:54:56 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:54:56 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:54:56 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:54:56 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:54:56 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:54:56 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:54:56 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:54:56 user nova-compute[75260]:       <nova:owner>
Nov 27 04:54:56 user nova-compute[75260]:         <nova:user uuid="cea49459be634b3bb4646f78b9c2798f">tempest-TestServerVolumeAttachmentScenario-1407041504-project-member</nova:user>
Nov 27 04:54:56 user nova-compute[75260]:         <nova:project uuid="cb59aff3328844a5b259f5a44e7bb574">tempest-TestServerVolumeAttachmentScenario-1407041504</nova:project>
Nov 27 04:54:56 user nova-compute[75260]:       </nova:owner>
Nov 27 04:54:56 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:54:56 user nova-compute[75260]:       <nova:ports>
Nov 27 04:54:56 user nova-compute[75260]:         <nova:port uuid="644a8370-b874-4106-afb9-751704c5e737">
Nov 27 04:54:56 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 04:54:56 user nova-compute[75260]:         </nova:port>
Nov 27 04:54:56 user nova-compute[75260]:       </nova:ports>
Nov 27 04:54:56 user nova-compute[75260]:     </nova:instance>
Nov 27 04:54:56 user nova-compute[75260]:   </metadata>
Nov 27 04:54:56 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:54:56 user nova-compute[75260]:     <system>
Nov 27 04:54:56 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:54:56 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:54:56 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:54:56 user nova-compute[75260]:       <entry name="serial">49bed705-0bcf-41aa-9acc-a8117d4d47b0</entry>
Nov 27 04:54:56 user nova-compute[75260]:       <entry name="uuid">49bed705-0bcf-41aa-9acc-a8117d4d47b0</entry>
Nov 27 04:54:56 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:54:56 user nova-compute[75260]:     </system>
Nov 27 04:54:56 user nova-compute[75260]:   </sysinfo>
Nov 27 04:54:56 user nova-compute[75260]:   <os>
Nov 27 04:54:56 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:54:56 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:54:56 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:54:56 user nova-compute[75260]:   </os>
Nov 27 04:54:56 user nova-compute[75260]:   <features>
Nov 27 04:54:56 user nova-compute[75260]:     <acpi/>
Nov 27 04:54:56 user nova-compute[75260]:     <apic/>
Nov 27 04:54:56 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:54:56 user nova-compute[75260]:   </features>
Nov 27 04:54:56 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:54:56 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:54:56 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:54:56 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:54:56 user nova-compute[75260]:   </clock>
Nov 27 04:54:56 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:54:56 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:54:56 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:54:56 user nova-compute[75260]:   </cpu>
Nov 27 04:54:56 user nova-compute[75260]:   <devices>
Nov 27 04:54:56 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:54:56 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:54:56 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk"/>
Nov 27 04:54:56 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:54:56 user nova-compute[75260]:     </disk>
Nov 27 04:54:56 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:54:56 user nova-compute[75260]:       <mac address="fa:16:3e:f6:af:22"/>
Nov 27 04:54:56 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:54:56 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:54:56 user nova-compute[75260]:       <target dev="tap644a8370-b8"/>
Nov 27 04:54:56 user nova-compute[75260]:     </interface>
Nov 27 04:54:56 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:54:56 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/console.log" append="off"/>
Nov 27 04:54:56 user nova-compute[75260]:     </serial>
Nov 27 04:54:56 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:54:56 user nova-compute[75260]:     <video>
Nov 27 04:54:56 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:54:56 user nova-compute[75260]:     </video>
Nov 27 04:54:56 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:54:56 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:54:56 user nova-compute[75260]:     </rng>
Nov 27 04:54:56 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:54:56 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:54:56 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:54:56 user nova-compute[75260]:     </memballoon>
Nov 27 04:54:56 user nova-compute[75260]:   </devices>
Nov 27 04:54:56 user nova-compute[75260]: </domain>
Nov 27 04:54:56 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1106648627',display_name='tempest-TestServerVolumeAttachmentScenario-server-1106648627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1106648627',id=34,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4dLAUmgCK8xsk+8hhhcJisYuJXmVkh9syMfzC+cbgie9XD3WDlZ1aHKkY8izXMMF+20hzoDhzYKTlXIM0/E9M1uURyq8Ca5i9n1NhF2Ad53iYQnrbrmmh1kgmWAsxncw==',key_name='tempest-keypair-1275059708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb59aff3328844a5b259f5a44e7bb574',ramdisk_id='',reservation_id='r-5t3ugpr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1407041504',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1407041504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea49459be634b3bb4646f78b9c2798f',uuid=49bed705-0bcf-41aa-9acc-a8117d4d47b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Converting VIF {"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:af:22,bridge_name='br-int',has_traffic_filtering=True,id=644a8370-b874-4106-afb9-751704c5e737,network=Network(d2f1b28f-1bde-474a-b6d7-62bdafb1b89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644a8370-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG os_vif [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:af:22,bridge_name='br-int',has_traffic_filtering=True,id=644a8370-b874-4106-afb9-751704c5e737,network=Network(d2f1b28f-1bde-474a-b6d7-62bdafb1b89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644a8370-b8') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '431c9bfc-4a06-5894-a2ea-5811a92b19ba', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap644a8370-b8, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap644a8370-b8, col_values=(('qos', UUID('e81328bf-761d-42b8-bc2c-a2f3d617385e')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap644a8370-b8, col_values=(('external_ids', {'iface-id': '644a8370-b874-4106-afb9-751704c5e737', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:af:22', 'vm-uuid': '49bed705-0bcf-41aa-9acc-a8117d4d47b0'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:56 user nova-compute[75260]: INFO os_vif [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:af:22,bridge_name='br-int',has_traffic_filtering=True,id=644a8370-b874-4106-afb9-751704c5e737,network=Network(d2f1b28f-1bde-474a-b6d7-62bdafb1b89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644a8370-b8')
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] No VIF found with MAC fa:16:3e:f6:af:22, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-7389aefb-683b-4fc7-9ce8-f75206973d9a req-4fb4bb14-483c-491a-898e-fbb534fae8d3 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Updated VIF entry in instance network info cache for port 644a8370-b874-4106-afb9-751704c5e737. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-7389aefb-683b-4fc7-9ce8-f75206973d9a req-4fb4bb14-483c-491a-898e-fbb534fae8d3 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Updating instance_info_cache with network_info: [{"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7389aefb-683b-4fc7-9ce8-f75206973d9a req-4fb4bb14-483c-491a-898e-fbb534fae8d3 service nova] Releasing lock "refresh_cache-49bed705-0bcf-41aa-9acc-a8117d4d47b0" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-e9d11307-a4ab-42ab-b53b-d2a2c4c80582 req-206144d4-f4be-469b-8dc3-ea8b03d87ba4 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e9d11307-a4ab-42ab-b53b-d2a2c4c80582 req-206144d4-f4be-469b-8dc3-ea8b03d87ba4 service nova] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e9d11307-a4ab-42ab-b53b-d2a2c4c80582 req-206144d4-f4be-469b-8dc3-ea8b03d87ba4 service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e9d11307-a4ab-42ab-b53b-d2a2c4c80582 req-206144d4-f4be-469b-8dc3-ea8b03d87ba4 service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-e9d11307-a4ab-42ab-b53b-d2a2c4c80582 req-206144d4-f4be-469b-8dc3-ea8b03d87ba4 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] No waiting events found dispatching network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:54:58 user nova-compute[75260]: WARNING nova.compute.manager [req-e9d11307-a4ab-42ab-b53b-d2a2c4c80582 req-206144d4-f4be-469b-8dc3-ea8b03d87ba4 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received unexpected event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 for instance with vm_state building and task_state spawning.
Nov 27 04:54:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:54:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-fc563704-51b8-418b-8ce3-c61b3d804557 req-be623f79-c8fc-49a1-807e-4975e66821cb service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fc563704-51b8-418b-8ce3-c61b3d804557 req-be623f79-c8fc-49a1-807e-4975e66821cb service nova] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fc563704-51b8-418b-8ce3-c61b3d804557 req-be623f79-c8fc-49a1-807e-4975e66821cb service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fc563704-51b8-418b-8ce3-c61b3d804557 req-be623f79-c8fc-49a1-807e-4975e66821cb service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-fc563704-51b8-418b-8ce3-c61b3d804557 req-be623f79-c8fc-49a1-807e-4975e66821cb service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] No waiting events found dispatching network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:00 user nova-compute[75260]: WARNING nova.compute.manager [req-fc563704-51b8-418b-8ce3-c61b3d804557 req-be623f79-c8fc-49a1-807e-4975e66821cb service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received unexpected event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 for instance with vm_state building and task_state spawning.
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:55:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Instance spawned successfully.
Nov 27 04:55:00 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:55:00 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7874MB free_disk=25.166301727294922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:00 user nova-compute[75260]: INFO nova.compute.manager [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Took 6.97 seconds to spawn the instance on the hypervisor.
Nov 27 04:55:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7c01d799-540f-469b-8417-5af70d803adf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance f29594ea-2a52-48ac-acfd-66e16dea9dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance de5b91ae-2b73-4620-93b7-73195724e610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:55:01 user nova-compute[75260]: INFO nova.compute.manager [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Took 7.99 seconds to build instance.
Nov 27 04:55:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-da4ba6a4-de0e-417e-9a3c-14c9e98531e1 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.113s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] There are 0 instances to clean {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 04:55:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:55:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:02 user nova-compute[75260]: INFO nova.compute.manager [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Detaching volume d0e039b7-5c3a-4ac7-8cbf-706b552a0168
Nov 27 04:55:02 user nova-compute[75260]: INFO nova.virt.block_device [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Attempting to driver detach volume d0e039b7-5c3a-4ac7-8cbf-706b552a0168 from mountpoint /dev/vdb
Nov 27 04:55:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Attempting to detach device vdb from instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:55:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:55:02 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:55:02 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:55:02 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:55:02 user nova-compute[75260]:   <serial>d0e039b7-5c3a-4ac7-8cbf-706b552a0168</serial>
Nov 27 04:55:02 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 04:55:02 user nova-compute[75260]: </disk>
Nov 27 04:55:02 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:55:02 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully detached device vdb from instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec from the persistent domain config.
Nov 27 04:55:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:55:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:55:02 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:55:02 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:55:02 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:55:02 user nova-compute[75260]:   <serial>d0e039b7-5c3a-4ac7-8cbf-706b552a0168</serial>
Nov 27 04:55:02 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 04:55:02 user nova-compute[75260]: </disk>
Nov 27 04:55:02 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:55:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:55:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-427a75ab-3570-4f05-8f08-6064b28c4529 req-437544e9-bcdd-46a7-bcea-5b0e868e14f1 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received event network-changed-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-427a75ab-3570-4f05-8f08-6064b28c4529 req-437544e9-bcdd-46a7-bcea-5b0e868e14f1 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Refreshing instance network info cache due to event network-changed-abea12ed-6f73-4322-a892-6c29383eaece. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-427a75ab-3570-4f05-8f08-6064b28c4529 req-437544e9-bcdd-46a7-bcea-5b0e868e14f1 service nova] Acquiring lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-427a75ab-3570-4f05-8f08-6064b28c4529 req-437544e9-bcdd-46a7-bcea-5b0e868e14f1 service nova] Acquired lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-427a75ab-3570-4f05-8f08-6064b28c4529 req-437544e9-bcdd-46a7-bcea-5b0e868e14f1 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Refreshing network info cache for port abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:07 user nova-compute[75260]: INFO nova.compute.manager [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Terminating instance
Nov 27 04:55:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-427a75ab-3570-4f05-8f08-6064b28c4529 req-437544e9-bcdd-46a7-bcea-5b0e868e14f1 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Updated VIF entry in instance network info cache for port abea12ed-6f73-4322-a892-6c29383eaece. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-427a75ab-3570-4f05-8f08-6064b28c4529 req-437544e9-bcdd-46a7-bcea-5b0e868e14f1 service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Updating instance_info_cache with network_info: [{"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:55:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-427a75ab-3570-4f05-8f08-6064b28c4529 req-437544e9-bcdd-46a7-bcea-5b0e868e14f1 service nova] Releasing lock "refresh_cache-f29594ea-2a52-48ac-acfd-66e16dea9dfd" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:55:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Instance destroyed successfully.
Nov 27 04:55:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lazy-loading 'resources' on Instance uuid f29594ea-2a52-48ac-acfd-66e16dea9dfd {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1561718750',display_name='tempest-TestStampPattern-server-1561718750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1561718750',id=32,image_ref='c8b18da7-d3b4-486d-bfd8-cfc6c2df8a36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEm4ycTHTc6irbNWzi82l/iS13TDWE7Tbj1uK6oYdFuMWX34xe8U7Ts31a/zWSA7B9JpTfl9arNxPKlrPcez9SIQg8qSky+ZGAnVKHoKPTF0lkUsqytbC2eApCQB/fW4Dw==',key_name='tempest-TestStampPattern-81536007',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:52:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06c37c5e030f48b293656f786ea1aeef',ramdisk_id='',reservation_id='r-imdr0hma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60da14c7-b49d-454d-ba99-ec308c4ceb96',image_min_disk='1',image_min_ram='0',image_owner_id='06c37c5e030f48b293656f786ea1aeef',image_owner_project_name='tempest-TestStampPattern-785030743',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-785030743-project-member',image_user_id='82e2cb36c4904d189ad7b29f933f480e',owner_project_name='tempest-TestStampPattern-785030743',owner_user_name='tempest-TestStampPattern-785030743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:52:13Z,user_data=None,user_id='82e2cb36c4904d189ad7b29f933f480e',uuid=f29594ea-2a52-48ac-acfd-66e16dea9dfd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converting VIF {"id": "abea12ed-6f73-4322-a892-6c29383eaece", "address": "fa:16:3e:91:84:60", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabea12ed-6f", "ovs_interfaceid": "abea12ed-6f73-4322-a892-6c29383eaece", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:84:60,bridge_name='br-int',has_traffic_filtering=True,id=abea12ed-6f73-4322-a892-6c29383eaece,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabea12ed-6f') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG os_vif [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:84:60,bridge_name='br-int',has_traffic_filtering=True,id=abea12ed-6f73-4322-a892-6c29383eaece,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabea12ed-6f') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabea12ed-6f, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2aad6f0c-5096-48a5-8e82-2be1a6c3180c) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:08 user nova-compute[75260]: INFO os_vif [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:84:60,bridge_name='br-int',has_traffic_filtering=True,id=abea12ed-6f73-4322-a892-6c29383eaece,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabea12ed-6f')
Nov 27 04:55:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Deleting instance files /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd_del
Nov 27 04:55:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Deletion of /opt/stack/data/nova/instances/f29594ea-2a52-48ac-acfd-66e16dea9dfd_del complete
Nov 27 04:55:08 user nova-compute[75260]: INFO nova.compute.manager [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 27 04:55:08 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:55:08 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Took 0.39 seconds to deallocate network for instance.
Nov 27 04:55:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:55:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:09 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Deleted allocations for instance f29594ea-2a52-48ac-acfd-66e16dea9dfd
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a6689551-6fcc-4be2-90fb-f54e5689e719 tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.904s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received event network-vif-unplugged-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] Acquiring lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] No waiting events found dispatching network-vif-unplugged-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:09 user nova-compute[75260]: WARNING nova.compute.manager [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received unexpected event network-vif-unplugged-abea12ed-6f73-4322-a892-6c29383eaece for instance with vm_state deleted and task_state None.
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received event network-vif-plugged-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] Acquiring lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] Lock "f29594ea-2a52-48ac-acfd-66e16dea9dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] No waiting events found dispatching network-vif-plugged-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:09 user nova-compute[75260]: WARNING nova.compute.manager [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received unexpected event network-vif-plugged-abea12ed-6f73-4322-a892-6c29383eaece for instance with vm_state deleted and task_state None.
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-82142e0e-c7bd-485b-8583-ed37ce60aa53 req-a0f6be03-9754-4351-821a-993824671b0a service nova] [instance: f29594ea-2a52-48ac-acfd-66e16dea9dfd] Received event network-vif-deleted-abea12ed-6f73-4322-a892-6c29383eaece {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 60da14c7-b49d-454d-ba99-ec308c4ceb96 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid de5b91ae-2b73-4620-93b7-73195724e610 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 97fdc474-4f43-40fa-b33f-a7e1e380f4ec {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "7c01d799-540f-469b-8417-5af70d803adf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "de5b91ae-2b73-4620-93b7-73195724e610" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "de5b91ae-2b73-4620-93b7-73195724e610" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "7c01d799-540f-469b-8417-5af70d803adf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "de5b91ae-2b73-4620-93b7-73195724e610" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:55:13 user nova-compute[75260]: INFO nova.compute.claims [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Claim successful on node user
Nov 27 04:55:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:55:13 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:55:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG nova.policy [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21ac605bebd04b48ac35eb2ad41e4e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff13437be5d4e46ab6ebe91272f08e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:55:13 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Creating image(s)
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "/opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "/opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk 1073741824" returned: 0 in 0.149s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Cannot resize image /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Ensure instance console log exists: /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:14 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Successfully created port: c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Successfully updated port: c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "refresh_cache-ed53fa6e-6fef-4293-b51c-989e7b343e94" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquired lock "refresh_cache-ed53fa6e-6fef-4293-b51c-989e7b343e94" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-fa182aaf-4bca-41fb-8c0a-5ec3a0bc6a77 req-971bae39-c9cf-4957-820c-dcac3d745bc8 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received event network-changed-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-fa182aaf-4bca-41fb-8c0a-5ec3a0bc6a77 req-971bae39-c9cf-4957-820c-dcac3d745bc8 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Refreshing instance network info cache due to event network-changed-c8b85997-6458-4494-8d0c-a9b3e3cc3b15. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fa182aaf-4bca-41fb-8c0a-5ec3a0bc6a77 req-971bae39-c9cf-4957-820c-dcac3d745bc8 service nova] Acquiring lock "refresh_cache-ed53fa6e-6fef-4293-b51c-989e7b343e94" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Updating instance_info_cache with network_info: [{"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Releasing lock "refresh_cache-ed53fa6e-6fef-4293-b51c-989e7b343e94" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Instance network_info: |[{"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fa182aaf-4bca-41fb-8c0a-5ec3a0bc6a77 req-971bae39-c9cf-4957-820c-dcac3d745bc8 service nova] Acquired lock "refresh_cache-ed53fa6e-6fef-4293-b51c-989e7b343e94" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.network.neutron [req-fa182aaf-4bca-41fb-8c0a-5ec3a0bc6a77 req-971bae39-c9cf-4957-820c-dcac3d745bc8 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Refreshing network info cache for port c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Start _get_guest_xml network_info=[{"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:55:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:55:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-30020084',display_name='tempest-VolumesSnapshotTestJSON-instance-30020084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-30020084',id=35,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb0mFNLrrV67IA+4i1d+1U9+dCQMrCqD4hSeVI35qlUKRgzjNHDKg1QrD/BgW+r2NQprOrP6C1iNqUSmHVu5xeYQrYfomiiYUPRSh7dToeBaU9cHxcZsPq1/StjEFCc7Q==',key_name='tempest-keypair-1679195181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bff13437be5d4e46ab6ebe91272f08e4',ramdisk_id='',reservation_id='r-9gmxll1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1878477578',owner_user_name='tempest-VolumesSnapshotTestJSON-1878477578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21ac605bebd04b48ac35eb2ad41e4e00',uuid=ed53fa6e-6fef-4293-b51c-989e7b343e94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converting VIF {"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=c8b85997-6458-4494-8d0c-a9b3e3cc3b15,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b85997-64') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.objects.instance [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lazy-loading 'pci_devices' on Instance uuid ed53fa6e-6fef-4293-b51c-989e7b343e94 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:55:15 user nova-compute[75260]:   <uuid>ed53fa6e-6fef-4293-b51c-989e7b343e94</uuid>
Nov 27 04:55:15 user nova-compute[75260]:   <name>instance-00000023</name>
Nov 27 04:55:15 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:55:15 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:55:15 user nova-compute[75260]:   <metadata>
Nov 27 04:55:15 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:55:15 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:55:15 user nova-compute[75260]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-30020084</nova:name>
Nov 27 04:55:15 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:55:15</nova:creationTime>
Nov 27 04:55:15 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:55:15 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:55:15 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:55:15 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:55:15 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:55:15 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:55:15 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:55:15 user nova-compute[75260]:       <nova:owner>
Nov 27 04:55:15 user nova-compute[75260]:         <nova:user uuid="21ac605bebd04b48ac35eb2ad41e4e00">tempest-VolumesSnapshotTestJSON-1878477578-project-member</nova:user>
Nov 27 04:55:15 user nova-compute[75260]:         <nova:project uuid="bff13437be5d4e46ab6ebe91272f08e4">tempest-VolumesSnapshotTestJSON-1878477578</nova:project>
Nov 27 04:55:15 user nova-compute[75260]:       </nova:owner>
Nov 27 04:55:15 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:55:15 user nova-compute[75260]:       <nova:ports>
Nov 27 04:55:15 user nova-compute[75260]:         <nova:port uuid="c8b85997-6458-4494-8d0c-a9b3e3cc3b15">
Nov 27 04:55:15 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 04:55:15 user nova-compute[75260]:         </nova:port>
Nov 27 04:55:15 user nova-compute[75260]:       </nova:ports>
Nov 27 04:55:15 user nova-compute[75260]:     </nova:instance>
Nov 27 04:55:15 user nova-compute[75260]:   </metadata>
Nov 27 04:55:15 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:55:15 user nova-compute[75260]:     <system>
Nov 27 04:55:15 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:55:15 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:55:15 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:55:15 user nova-compute[75260]:       <entry name="serial">ed53fa6e-6fef-4293-b51c-989e7b343e94</entry>
Nov 27 04:55:15 user nova-compute[75260]:       <entry name="uuid">ed53fa6e-6fef-4293-b51c-989e7b343e94</entry>
Nov 27 04:55:15 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:55:15 user nova-compute[75260]:     </system>
Nov 27 04:55:15 user nova-compute[75260]:   </sysinfo>
Nov 27 04:55:15 user nova-compute[75260]:   <os>
Nov 27 04:55:15 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:55:15 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:55:15 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:55:15 user nova-compute[75260]:   </os>
Nov 27 04:55:15 user nova-compute[75260]:   <features>
Nov 27 04:55:15 user nova-compute[75260]:     <acpi/>
Nov 27 04:55:15 user nova-compute[75260]:     <apic/>
Nov 27 04:55:15 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:55:15 user nova-compute[75260]:   </features>
Nov 27 04:55:15 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:55:15 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:55:15 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:55:15 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:55:15 user nova-compute[75260]:   </clock>
Nov 27 04:55:15 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:55:15 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:55:15 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:55:15 user nova-compute[75260]:   </cpu>
Nov 27 04:55:15 user nova-compute[75260]:   <devices>
Nov 27 04:55:15 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:55:15 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:55:15 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk"/>
Nov 27 04:55:15 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:55:15 user nova-compute[75260]:     </disk>
Nov 27 04:55:15 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:55:15 user nova-compute[75260]:       <mac address="fa:16:3e:50:c9:a7"/>
Nov 27 04:55:15 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:55:15 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:55:15 user nova-compute[75260]:       <target dev="tapc8b85997-64"/>
Nov 27 04:55:15 user nova-compute[75260]:     </interface>
Nov 27 04:55:15 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:55:15 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/console.log" append="off"/>
Nov 27 04:55:15 user nova-compute[75260]:     </serial>
Nov 27 04:55:15 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:55:15 user nova-compute[75260]:     <video>
Nov 27 04:55:15 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:55:15 user nova-compute[75260]:     </video>
Nov 27 04:55:15 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:55:15 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:55:15 user nova-compute[75260]:     </rng>
Nov 27 04:55:15 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:55:15 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:55:15 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:55:15 user nova-compute[75260]:     </memballoon>
Nov 27 04:55:15 user nova-compute[75260]:   </devices>
Nov 27 04:55:15 user nova-compute[75260]: </domain>
Nov 27 04:55:15 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-30020084',display_name='tempest-VolumesSnapshotTestJSON-instance-30020084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-30020084',id=35,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb0mFNLrrV67IA+4i1d+1U9+dCQMrCqD4hSeVI35qlUKRgzjNHDKg1QrD/BgW+r2NQprOrP6C1iNqUSmHVu5xeYQrYfomiiYUPRSh7dToeBaU9cHxcZsPq1/StjEFCc7Q==',key_name='tempest-keypair-1679195181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bff13437be5d4e46ab6ebe91272f08e4',ramdisk_id='',reservation_id='r-9gmxll1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1878477578',owner_user_name='tempest-VolumesSnapshotTestJSON-1878477578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21ac605bebd04b48ac35eb2ad41e4e00',uuid=ed53fa6e-6fef-4293-b51c-989e7b343e94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converting VIF {"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=c8b85997-6458-4494-8d0c-a9b3e3cc3b15,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b85997-64') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG os_vif [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=c8b85997-6458-4494-8d0c-a9b3e3cc3b15,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b85997-64') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e389479-d9c4-56cf-81e5-3bdc502f330f', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8b85997-64, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8b85997-64, col_values=(('qos', UUID('9ab7a5ef-ca4a-4fc0-8bde-8d35061a41ed')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8b85997-64, col_values=(('external_ids', {'iface-id': 'c8b85997-6458-4494-8d0c-a9b3e3cc3b15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:c9:a7', 'vm-uuid': 'ed53fa6e-6fef-4293-b51c-989e7b343e94'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:15 user nova-compute[75260]: INFO os_vif [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=c8b85997-6458-4494-8d0c-a9b3e3cc3b15,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b85997-64')
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:55:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] No VIF found with MAC fa:16:3e:50:c9:a7, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:55:16 user nova-compute[75260]: DEBUG nova.network.neutron [req-fa182aaf-4bca-41fb-8c0a-5ec3a0bc6a77 req-971bae39-c9cf-4957-820c-dcac3d745bc8 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Updated VIF entry in instance network info cache for port c8b85997-6458-4494-8d0c-a9b3e3cc3b15. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:55:16 user nova-compute[75260]: DEBUG nova.network.neutron [req-fa182aaf-4bca-41fb-8c0a-5ec3a0bc6a77 req-971bae39-c9cf-4957-820c-dcac3d745bc8 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Updating instance_info_cache with network_info: [{"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:55:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fa182aaf-4bca-41fb-8c0a-5ec3a0bc6a77 req-971bae39-c9cf-4957-820c-dcac3d745bc8 service nova] Releasing lock "refresh_cache-ed53fa6e-6fef-4293-b51c-989e7b343e94" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-d97c2de1-0096-4c0d-8753-ac404611c085 req-9ea322b4-76e7-4446-83a2-fa02bf995ed2 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received event network-vif-plugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d97c2de1-0096-4c0d-8753-ac404611c085 req-9ea322b4-76e7-4446-83a2-fa02bf995ed2 service nova] Acquiring lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d97c2de1-0096-4c0d-8753-ac404611c085 req-9ea322b4-76e7-4446-83a2-fa02bf995ed2 service nova] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d97c2de1-0096-4c0d-8753-ac404611c085 req-9ea322b4-76e7-4446-83a2-fa02bf995ed2 service nova] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-d97c2de1-0096-4c0d-8753-ac404611c085 req-9ea322b4-76e7-4446-83a2-fa02bf995ed2 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] No waiting events found dispatching network-vif-plugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:17 user nova-compute[75260]: WARNING nova.compute.manager [req-d97c2de1-0096-4c0d-8753-ac404611c085 req-9ea322b4-76e7-4446-83a2-fa02bf995ed2 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received unexpected event network-vif-plugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 for instance with vm_state building and task_state spawning.
Nov 27 04:55:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:55:19 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Instance spawned successfully.
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:55:19 user nova-compute[75260]: INFO nova.compute.manager [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-3c68309d-15c5-4bd7-940d-07fc75390220 req-e9d1c277-c79e-43be-956e-d77372e8b90a service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received event network-vif-plugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3c68309d-15c5-4bd7-940d-07fc75390220 req-e9d1c277-c79e-43be-956e-d77372e8b90a service nova] Acquiring lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3c68309d-15c5-4bd7-940d-07fc75390220 req-e9d1c277-c79e-43be-956e-d77372e8b90a service nova] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3c68309d-15c5-4bd7-940d-07fc75390220 req-e9d1c277-c79e-43be-956e-d77372e8b90a service nova] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-3c68309d-15c5-4bd7-940d-07fc75390220 req-e9d1c277-c79e-43be-956e-d77372e8b90a service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] No waiting events found dispatching network-vif-plugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:19 user nova-compute[75260]: WARNING nova.compute.manager [req-3c68309d-15c5-4bd7-940d-07fc75390220 req-e9d1c277-c79e-43be-956e-d77372e8b90a service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received unexpected event network-vif-plugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 for instance with vm_state active and task_state None.
Nov 27 04:55:19 user nova-compute[75260]: INFO nova.compute.manager [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Took 6.49 seconds to build instance.
Nov 27 04:55:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1dcb05ac-3a26-4c89-aaa3-55bee0368925 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.582s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:22 user nova-compute[75260]: INFO nova.compute.manager [None req-fd68f3b9-7af4-4519-8e51-51c8acfabcde tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Unrescuing
Nov 27 04:55:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fd68f3b9-7af4-4519-8e51-51c8acfabcde tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:55:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fd68f3b9-7af4-4519-8e51-51c8acfabcde tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquired lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:55:22 user nova-compute[75260]: DEBUG nova.network.neutron [None req-fd68f3b9-7af4-4519-8e51-51c8acfabcde tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:55:22 user nova-compute[75260]: DEBUG nova.network.neutron [None req-fd68f3b9-7af4-4519-8e51-51c8acfabcde tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updating instance_info_cache with network_info: [{"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:55:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fd68f3b9-7af4-4519-8e51-51c8acfabcde tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Releasing lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:55:22 user nova-compute[75260]: DEBUG nova.objects.instance [None req-fd68f3b9-7af4-4519-8e51-51c8acfabcde tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'flavor' on Instance uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:23 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec is timed out.
Nov 27 04:55:23 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully detached device vdb from instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec from the live domain config.
Nov 27 04:55:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esNnabOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:55:23 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad36441b-ea01-4be8-9afb-1984866d23ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:269460d2-4900-436d-9fd2-694a232d74c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:55:23 user nova-compute[75260]: No targets found.
Nov 27 04:55:23 user nova-compute[75260]: iSNS:
Nov 27 04:55:23 user nova-compute[75260]: No targets found.
Nov 27 04:55:23 user nova-compute[75260]: STATIC:
Nov 27 04:55:23 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:55:23 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:55:23 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:55:23 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168
Nov 27 04:55:23 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:55:23 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:55:23 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:269460d2-4900-436d-9fd2-694a232d74c6
Nov 27 04:55:23 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:55:23 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:55:23 user nova-compute[75260]: FIRMWARE:
Nov 27 04:55:23 user nova-compute[75260]: No targets found.
Nov 27 04:55:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:55:23 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:55:23 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d93a116-d50d-4dcb-a2f6-2a5c969f08b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:269460d2-4900-436d-9fd2-694a232d74c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG nova.compute.manager [req-e12932cc-c9de-424b-ac62-2db5b4471231 req-af2cdba3-3e8d-4957-9c7b-cf3be250cae0 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-unplugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e12932cc-c9de-424b-ac62-2db5b4471231 req-af2cdba3-3e8d-4957-9c7b-cf3be250cae0 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e12932cc-c9de-424b-ac62-2db5b4471231 req-af2cdba3-3e8d-4957-9c7b-cf3be250cae0 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e12932cc-c9de-424b-ac62-2db5b4471231 req-af2cdba3-3e8d-4957-9c7b-cf3be250cae0 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG nova.compute.manager [req-e12932cc-c9de-424b-ac62-2db5b4471231 req-af2cdba3-3e8d-4957-9c7b-cf3be250cae0 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-unplugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:23 user nova-compute[75260]: WARNING nova.compute.manager [req-e12932cc-c9de-424b-ac62-2db5b4471231 req-af2cdba3-3e8d-4957-9c7b-cf3be250cae0 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-unplugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3eaa8c-fe7f-4001-8783-a1af3c684bc6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:269460d2-4900-436d-9fd2-694a232d74c6 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:55:23 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:55:23 user nova-compute[75260]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:269460d2-4900-436d-9fd2-694a232d74c6 (non-flash)
Nov 27 04:55:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:55:23 user nova-compute[75260]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 (non-flash)
Nov 27 04:55:23 user nova-compute[75260]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:269460d2-4900-436d-9fd2-694a232d74c6 (non-flash)
Nov 27 04:55:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb742e8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd093934-a790-4586-a3bb-f9328d7ae899]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f8282d-681a-4811-a80b-6da31becc157]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac3f9b7-f59a-43c1-956f-83b66b981765]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e768b930-c5d9-41e7-8d69-03099244ced6]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f018447b-198d-45b7-9e90-792d2df59356]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfba0b0-aadb-481f-a3fb-0ce54593b776]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260]
Nov 27 04:55:23 user nova-compute[75260]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168, portal: 172.16.0.220,3260] successful.
Nov 27 04:55:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e039b7-5c3a-4ac7-8cbf-706b552a0168 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccabf585-070a-4e85-a07a-c2395e6391f6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== disconnect_volume: return (345ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:55:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:55:23 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Instance destroyed successfully.
Nov 27 04:55:24 user nova-compute[75260]: DEBUG nova.objects.instance [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'flavor' on Instance uuid 97fdc474-4f43-40fa-b33f-a7e1e380f4ec {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:55:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-61e002ba-cb49-4d64-b717-e11d63438357 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.006s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.651s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-50a0bf65-c916-4d8a-9a08-185d1f158c40 req-3157e527-c087-4307-b725-a20754a55719 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-50a0bf65-c916-4d8a-9a08-185d1f158c40 req-3157e527-c087-4307-b725-a20754a55719 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-50a0bf65-c916-4d8a-9a08-185d1f158c40 req-3157e527-c087-4307-b725-a20754a55719 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-50a0bf65-c916-4d8a-9a08-185d1f158c40 req-3157e527-c087-4307-b725-a20754a55719 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-50a0bf65-c916-4d8a-9a08-185d1f158c40 req-3157e527-c087-4307-b725-a20754a55719 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:25 user nova-compute[75260]: WARNING nova.compute.manager [req-50a0bf65-c916-4d8a-9a08-185d1f158c40 req-3157e527-c087-4307-b725-a20754a55719 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:55:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:27 user nova-compute[75260]: WARNING nova.compute.manager [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:55:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:27 user nova-compute[75260]: WARNING nova.compute.manager [req-0a6f1c1b-11f6-48d1-b223-a2744b6f5e8a req-77201535-e366-43c1-b47a-16e597f991d5 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state rescued and task_state unrescuing.
Nov 27 04:55:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-fd68f3b9-7af4-4519-8e51-51c8acfabcde tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:55:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "7c01d799-540f-469b-8417-5af70d803adf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:40 user nova-compute[75260]: INFO nova.compute.manager [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Terminating instance
Nov 27 04:55:40 user nova-compute[75260]: DEBUG nova.compute.manager [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-67875948-20a5-4220-b773-370a591470cf req-b6f62ed9-d08e-440b-9eaa-38046f960899 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-unplugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-67875948-20a5-4220-b773-370a591470cf req-b6f62ed9-d08e-440b-9eaa-38046f960899 service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-67875948-20a5-4220-b773-370a591470cf req-b6f62ed9-d08e-440b-9eaa-38046f960899 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-67875948-20a5-4220-b773-370a591470cf req-b6f62ed9-d08e-440b-9eaa-38046f960899 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-67875948-20a5-4220-b773-370a591470cf req-b6f62ed9-d08e-440b-9eaa-38046f960899 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-unplugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-67875948-20a5-4220-b773-370a591470cf req-b6f62ed9-d08e-440b-9eaa-38046f960899 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-unplugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:41 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Instance destroyed successfully.
Nov 27 04:55:41 user nova-compute[75260]: DEBUG nova.objects.instance [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lazy-loading 'resources' on Instance uuid 7c01d799-540f-469b-8417-5af70d803adf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1181510226',display_name='tempest-ServerRescueNegativeTestJSON-server-1181510226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1181510226',id=1,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e5f7694b2294e16aec0248f1217b148',ramdisk_id='',reservation_id='r-3w0rf0rf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1319145768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1319145768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:45:25Z,user_data=None,user_id='41069f4d1d404da19dcfb2a3552fcddb',uuid=7c01d799-540f-469b-8417-5af70d803adf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converting VIF {"id": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "address": "fa:16:3e:a5:25:f7", "network": {"id": "299f23fb-c4ba-4119-bcf0-6b2d337c7a37", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1093670878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e5f7694b2294e16aec0248f1217b148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240c5141-ac", "ovs_interfaceid": "240c5141-ac9c-45d3-ba42-5e854ceee9ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:25:f7,bridge_name='br-int',has_traffic_filtering=True,id=240c5141-ac9c-45d3-ba42-5e854ceee9ed,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240c5141-ac') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG os_vif [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:25:f7,bridge_name='br-int',has_traffic_filtering=True,id=240c5141-ac9c-45d3-ba42-5e854ceee9ed,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240c5141-ac') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap240c5141-ac, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a63ce9c3-b5c6-4d87-90e0-b4ecabe55265) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:41 user nova-compute[75260]: INFO os_vif [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:25:f7,bridge_name='br-int',has_traffic_filtering=True,id=240c5141-ac9c-45d3-ba42-5e854ceee9ed,network=Network(299f23fb-c4ba-4119-bcf0-6b2d337c7a37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240c5141-ac')
Nov 27 04:55:41 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Deleting instance files /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf_del
Nov 27 04:55:41 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Deletion of /opt/stack/data/nova/instances/7c01d799-540f-469b-8417-5af70d803adf_del complete
Nov 27 04:55:41 user nova-compute[75260]: INFO nova.compute.manager [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 27 04:55:41 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:55:41 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 7c01d799-540f-469b-8417-5af70d803adf] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:55:42 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:55:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:42 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Took 0.43 seconds to deallocate network for instance.
Nov 27 04:55:42 user nova-compute[75260]: DEBUG nova.compute.manager [req-c02428d2-aa59-40c0-a149-560ae07c25ad req-3ae96ef2-238f-4828-be8c-f68060fb07b1 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-deleted-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:42 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:55:42 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:55:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:42 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Deleted allocations for instance 7c01d799-540f-469b-8417-5af70d803adf
Nov 27 04:55:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-1c573942-cb96-4c18-9966-220147767038 tempest-ServerRescueNegativeTestJSON-1319145768 tempest-ServerRescueNegativeTestJSON-1319145768-project-member] Lock "7c01d799-540f-469b-8417-5af70d803adf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-f4a1569a-37fa-4e7a-89b4-81b287fd8cf9 req-e37120e9-d194-4fb9-9edf-5fe8ed239670 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f4a1569a-37fa-4e7a-89b4-81b287fd8cf9 req-e37120e9-d194-4fb9-9edf-5fe8ed239670 service nova] Acquiring lock "7c01d799-540f-469b-8417-5af70d803adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f4a1569a-37fa-4e7a-89b4-81b287fd8cf9 req-e37120e9-d194-4fb9-9edf-5fe8ed239670 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f4a1569a-37fa-4e7a-89b4-81b287fd8cf9 req-e37120e9-d194-4fb9-9edf-5fe8ed239670 service nova] Lock "7c01d799-540f-469b-8417-5af70d803adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-f4a1569a-37fa-4e7a-89b4-81b287fd8cf9 req-e37120e9-d194-4fb9-9edf-5fe8ed239670 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] No waiting events found dispatching network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:43 user nova-compute[75260]: WARNING nova.compute.manager [req-f4a1569a-37fa-4e7a-89b4-81b287fd8cf9 req-e37120e9-d194-4fb9-9edf-5fe8ed239670 service nova] [instance: 7c01d799-540f-469b-8417-5af70d803adf] Received unexpected event network-vif-plugged-240c5141-ac9c-45d3-ba42-5e854ceee9ed for instance with vm_state deleted and task_state None.
Nov 27 04:55:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "de5b91ae-2b73-4620-93b7-73195724e610" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "de5b91ae-2b73-4620-93b7-73195724e610" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "de5b91ae-2b73-4620-93b7-73195724e610-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "de5b91ae-2b73-4620-93b7-73195724e610-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "de5b91ae-2b73-4620-93b7-73195724e610-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:44 user nova-compute[75260]: INFO nova.compute.manager [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Terminating instance
Nov 27 04:55:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-1f8e4f8e-7716-46e6-9475-70676605d4e4 req-ed494109-7134-400d-8f89-4ce6ccc4d33f service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Received event network-vif-unplugged-db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1f8e4f8e-7716-46e6-9475-70676605d4e4 req-ed494109-7134-400d-8f89-4ce6ccc4d33f service nova] Acquiring lock "de5b91ae-2b73-4620-93b7-73195724e610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1f8e4f8e-7716-46e6-9475-70676605d4e4 req-ed494109-7134-400d-8f89-4ce6ccc4d33f service nova] Lock "de5b91ae-2b73-4620-93b7-73195724e610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1f8e4f8e-7716-46e6-9475-70676605d4e4 req-ed494109-7134-400d-8f89-4ce6ccc4d33f service nova] Lock "de5b91ae-2b73-4620-93b7-73195724e610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-1f8e4f8e-7716-46e6-9475-70676605d4e4 req-ed494109-7134-400d-8f89-4ce6ccc4d33f service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] No waiting events found dispatching network-vif-unplugged-db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-1f8e4f8e-7716-46e6-9475-70676605d4e4 req-ed494109-7134-400d-8f89-4ce6ccc4d33f service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Received event network-vif-unplugged-db7ad84a-4118-4bf9-8682-65838684c9e2 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Instance destroyed successfully.
Nov 27 04:55:44 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lazy-loading 'resources' on Instance uuid de5b91ae-2b73-4620-93b7-73195724e610 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:53:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1860006207',display_name='tempest-VolumesActionsTest-instance-1860006207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1860006207',id=33,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b0696f0dfdd40db9b5e8b9aa6397ab7',ramdisk_id='',reservation_id='r-06bykopc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1777164428',owner_user_name='tempest-VolumesActionsTest-1777164428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:54:00Z,user_data=None,user_id='47c5ef7ba8434a4797330f38f74439f6',uuid=de5b91ae-2b73-4620-93b7-73195724e610,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db7ad84a-4118-4bf9-8682-65838684c9e2", "address": "fa:16:3e:e6:ef:71", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7ad84a-41", "ovs_interfaceid": "db7ad84a-4118-4bf9-8682-65838684c9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converting VIF {"id": "db7ad84a-4118-4bf9-8682-65838684c9e2", "address": "fa:16:3e:e6:ef:71", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7ad84a-41", "ovs_interfaceid": "db7ad84a-4118-4bf9-8682-65838684c9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=db7ad84a-4118-4bf9-8682-65838684c9e2,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7ad84a-41') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG os_vif [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=db7ad84a-4118-4bf9-8682-65838684c9e2,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7ad84a-41') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb7ad84a-41, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fab601b1-7b1e-45c2-9442-da1cd0d7f096) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:55:44 user nova-compute[75260]: INFO os_vif [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=db7ad84a-4118-4bf9-8682-65838684c9e2,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7ad84a-41')
Nov 27 04:55:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Deleting instance files /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610_del
Nov 27 04:55:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Deletion of /opt/stack/data/nova/instances/de5b91ae-2b73-4620-93b7-73195724e610_del complete
Nov 27 04:55:44 user nova-compute[75260]: INFO nova.compute.manager [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 27 04:55:44 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:55:44 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: de5b91ae-2b73-4620-93b7-73195724e610] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:55:45 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:55:45 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Took 0.83 seconds to deallocate network for instance.
Nov 27 04:55:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:46 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:55:46 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:55:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:46 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Deleted allocations for instance de5b91ae-2b73-4620-93b7-73195724e610
Nov 27 04:55:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b88a0503-32ff-4dde-a7ef-c840f414b50d tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "de5b91ae-2b73-4620-93b7-73195724e610" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.129s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-148927a9-d466-4251-9ead-9a7ceffc7aef req-babb9ff5-2349-4767-82ad-82bf360be5b5 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Received event network-vif-plugged-db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-148927a9-d466-4251-9ead-9a7ceffc7aef req-babb9ff5-2349-4767-82ad-82bf360be5b5 service nova] Acquiring lock "de5b91ae-2b73-4620-93b7-73195724e610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-148927a9-d466-4251-9ead-9a7ceffc7aef req-babb9ff5-2349-4767-82ad-82bf360be5b5 service nova] Lock "de5b91ae-2b73-4620-93b7-73195724e610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-148927a9-d466-4251-9ead-9a7ceffc7aef req-babb9ff5-2349-4767-82ad-82bf360be5b5 service nova] Lock "de5b91ae-2b73-4620-93b7-73195724e610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-148927a9-d466-4251-9ead-9a7ceffc7aef req-babb9ff5-2349-4767-82ad-82bf360be5b5 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] No waiting events found dispatching network-vif-plugged-db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:46 user nova-compute[75260]: WARNING nova.compute.manager [req-148927a9-d466-4251-9ead-9a7ceffc7aef req-babb9ff5-2349-4767-82ad-82bf360be5b5 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Received unexpected event network-vif-plugged-db7ad84a-4118-4bf9-8682-65838684c9e2 for instance with vm_state deleted and task_state None.
Nov 27 04:55:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-148927a9-d466-4251-9ead-9a7ceffc7aef req-babb9ff5-2349-4767-82ad-82bf360be5b5 service nova] [instance: de5b91ae-2b73-4620-93b7-73195724e610] Received event network-vif-deleted-db7ad84a-4118-4bf9-8682-65838684c9e2 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:47 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:49 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:50 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:50 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:55:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:55:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:55:50 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:55:51 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Updating instance_info_cache with network_info: [{"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:55:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:55:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:55:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:52 user nova-compute[75260]: INFO nova.compute.manager [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Terminating instance
Nov 27 04:55:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:55:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-76257c03-778a-495d-96b4-ea768315f631 req-53895d71-10ba-42f4-be7a-07ef21271d31 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-vif-unplugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-76257c03-778a-495d-96b4-ea768315f631 req-53895d71-10ba-42f4-be7a-07ef21271d31 service nova] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-76257c03-778a-495d-96b4-ea768315f631 req-53895d71-10ba-42f4-be7a-07ef21271d31 service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-76257c03-778a-495d-96b4-ea768315f631 req-53895d71-10ba-42f4-be7a-07ef21271d31 service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-76257c03-778a-495d-96b4-ea768315f631 req-53895d71-10ba-42f4-be7a-07ef21271d31 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] No waiting events found dispatching network-vif-unplugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-76257c03-778a-495d-96b4-ea768315f631 req-53895d71-10ba-42f4-be7a-07ef21271d31 service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-vif-unplugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:55:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Instance destroyed successfully.
Nov 27 04:55:53 user nova-compute[75260]: DEBUG nova.objects.instance [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'resources' on Instance uuid 97fdc474-4f43-40fa-b33f-a7e1e380f4ec {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T04:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-195716123',display_name='tempest-ServerActionsTestOtherA-server-1448587439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-195716123',id=30,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4R7s2prxxnZaQ+FL9NIcHHXMgfD6VF3HAU7eh7ww4DCPun1aOULgPRw6EAugomVlJUlPfVA9bor4qx9I5jy6H2NQrtP0cswCG82jNOmi6CoeOEhcRtUcgxt3wrB3pMsw==',key_name='tempest-keypair-1968778781',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-79585enr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:52:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=97fdc474-4f43-40fa-b33f-a7e1e380f4ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "address": "fa:16:3e:17:4b:bb", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee2fcfd-34", "ovs_interfaceid": "3ee2fcfd-34f7-45ae-b191-e8459d03647b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG os_vif [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ee2fcfd-34, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e716980-26c4-4e05-9ccd-9124feb60b1e) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:55:53 user nova-compute[75260]: INFO os_vif [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:4b:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ee2fcfd-34f7-45ae-b191-e8459d03647b,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee2fcfd-34')
Nov 27 04:55:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Deleting instance files /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec_del
Nov 27 04:55:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Deletion of /opt/stack/data/nova/instances/97fdc474-4f43-40fa-b33f-a7e1e380f4ec_del complete
Nov 27 04:55:53 user nova-compute[75260]: INFO nova.compute.manager [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 27 04:55:53 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:55:53 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:54 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:55:54 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Took 0.76 seconds to deallocate network for instance.
Nov 27 04:55:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:54 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:55:54 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:55:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:54 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Deleted allocations for instance 97fdc474-4f43-40fa-b33f-a7e1e380f4ec
Nov 27 04:55:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-21b25d7b-9d70-4d0b-9d00-fdf485b29f1f tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.004s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:54 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:55:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:54 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-508cb7a8-0ddb-463f-a7fc-752a0faad11b req-5f1a7fa6-a074-4031-8949-628bb714772f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-508cb7a8-0ddb-463f-a7fc-752a0faad11b req-5f1a7fa6-a074-4031-8949-628bb714772f service nova] Acquiring lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-508cb7a8-0ddb-463f-a7fc-752a0faad11b req-5f1a7fa6-a074-4031-8949-628bb714772f service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-508cb7a8-0ddb-463f-a7fc-752a0faad11b req-5f1a7fa6-a074-4031-8949-628bb714772f service nova] Lock "97fdc474-4f43-40fa-b33f-a7e1e380f4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-508cb7a8-0ddb-463f-a7fc-752a0faad11b req-5f1a7fa6-a074-4031-8949-628bb714772f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] No waiting events found dispatching network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:55:55 user nova-compute[75260]: WARNING nova.compute.manager [req-508cb7a8-0ddb-463f-a7fc-752a0faad11b req-5f1a7fa6-a074-4031-8949-628bb714772f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received unexpected event network-vif-plugged-3ee2fcfd-34f7-45ae-b191-e8459d03647b for instance with vm_state deleted and task_state None.
Nov 27 04:55:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-508cb7a8-0ddb-463f-a7fc-752a0faad11b req-5f1a7fa6-a074-4031-8949-628bb714772f service nova] [instance: 97fdc474-4f43-40fa-b33f-a7e1e380f4ec] Received event network-vif-deleted-3ee2fcfd-34f7-45ae-b191-e8459d03647b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:55:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:55:57 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:55:57 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8038MB free_disk=25.184375762939453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance ed53fa6e-6fef-4293-b51c-989e7b343e94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:55:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:55:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:56:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:56:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-e4c0709f-2382-4201-b6eb-4f32ff311c97 req-38b88dcb-af18-40bc-8b81-7f442a7b829b service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received event network-changed-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-e4c0709f-2382-4201-b6eb-4f32ff311c97 req-38b88dcb-af18-40bc-8b81-7f442a7b829b service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Refreshing instance network info cache due to event network-changed-d051edcd-601a-4c12-b8b0-7f1081837279. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e4c0709f-2382-4201-b6eb-4f32ff311c97 req-38b88dcb-af18-40bc-8b81-7f442a7b829b service nova] Acquiring lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e4c0709f-2382-4201-b6eb-4f32ff311c97 req-38b88dcb-af18-40bc-8b81-7f442a7b829b service nova] Acquired lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-e4c0709f-2382-4201-b6eb-4f32ff311c97 req-38b88dcb-af18-40bc-8b81-7f442a7b829b service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Refreshing network info cache for port d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:07 user nova-compute[75260]: INFO nova.compute.manager [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Terminating instance
Nov 27 04:56:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-eb575197-170b-451f-a7b4-5ae0d22181df req-cb4cdc29-cc71-4d75-8e57-5be5be0a573b service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received event network-vif-unplugged-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eb575197-170b-451f-a7b4-5ae0d22181df req-cb4cdc29-cc71-4d75-8e57-5be5be0a573b service nova] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eb575197-170b-451f-a7b4-5ae0d22181df req-cb4cdc29-cc71-4d75-8e57-5be5be0a573b service nova] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eb575197-170b-451f-a7b4-5ae0d22181df req-cb4cdc29-cc71-4d75-8e57-5be5be0a573b service nova] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-eb575197-170b-451f-a7b4-5ae0d22181df req-cb4cdc29-cc71-4d75-8e57-5be5be0a573b service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] No waiting events found dispatching network-vif-unplugged-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:56:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-eb575197-170b-451f-a7b4-5ae0d22181df req-cb4cdc29-cc71-4d75-8e57-5be5be0a573b service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received event network-vif-unplugged-d051edcd-601a-4c12-b8b0-7f1081837279 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.network.neutron [req-e4c0709f-2382-4201-b6eb-4f32ff311c97 req-38b88dcb-af18-40bc-8b81-7f442a7b829b service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Updated VIF entry in instance network info cache for port d051edcd-601a-4c12-b8b0-7f1081837279. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.network.neutron [req-e4c0709f-2382-4201-b6eb-4f32ff311c97 req-38b88dcb-af18-40bc-8b81-7f442a7b829b service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Updating instance_info_cache with network_info: [{"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e4c0709f-2382-4201-b6eb-4f32ff311c97 req-38b88dcb-af18-40bc-8b81-7f442a7b829b service nova] Releasing lock "refresh_cache-60da14c7-b49d-454d-ba99-ec308c4ceb96" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:56:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Instance destroyed successfully.
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lazy-loading 'resources' on Instance uuid 60da14c7-b49d-454d-ba99-ec308c4ceb96 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1619704992',display_name='tempest-TestStampPattern-server-1619704992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1619704992',id=27,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEm4ycTHTc6irbNWzi82l/iS13TDWE7Tbj1uK6oYdFuMWX34xe8U7Ts31a/zWSA7B9JpTfl9arNxPKlrPcez9SIQg8qSky+ZGAnVKHoKPTF0lkUsqytbC2eApCQB/fW4Dw==',key_name='tempest-TestStampPattern-81536007',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:49:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06c37c5e030f48b293656f786ea1aeef',ramdisk_id='',reservation_id='r-hjzmv68y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-785030743',owner_user_name='tempest-TestStampPattern-785030743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:52:03Z,user_data=None,user_id='82e2cb36c4904d189ad7b29f933f480e',uuid=60da14c7-b49d-454d-ba99-ec308c4ceb96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converting VIF {"id": "d051edcd-601a-4c12-b8b0-7f1081837279", "address": "fa:16:3e:53:83:c0", "network": {"id": "36868cd4-fa00-4e78-80d5-3d34c439afc0", "bridge": "br-int", "label": "tempest-TestStampPattern-954951893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06c37c5e030f48b293656f786ea1aeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd051edcd-60", "ovs_interfaceid": "d051edcd-601a-4c12-b8b0-7f1081837279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:83:c0,bridge_name='br-int',has_traffic_filtering=True,id=d051edcd-601a-4c12-b8b0-7f1081837279,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd051edcd-60') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG os_vif [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:83:c0,bridge_name='br-int',has_traffic_filtering=True,id=d051edcd-601a-4c12-b8b0-7f1081837279,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd051edcd-60') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd051edcd-60, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50016549-a856-43d7-a3fc-a5e4a60a6e4f) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:08 user nova-compute[75260]: INFO os_vif [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:83:c0,bridge_name='br-int',has_traffic_filtering=True,id=d051edcd-601a-4c12-b8b0-7f1081837279,network=Network(36868cd4-fa00-4e78-80d5-3d34c439afc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd051edcd-60')
Nov 27 04:56:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Deleting instance files /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96_del
Nov 27 04:56:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Deletion of /opt/stack/data/nova/instances/60da14c7-b49d-454d-ba99-ec308c4ceb96_del complete
Nov 27 04:56:08 user nova-compute[75260]: INFO nova.compute.manager [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 27 04:56:08 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:56:08 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Took 0.43 seconds to deallocate network for instance.
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.compute.manager [req-2d051ca7-fc01-43a4-b210-f25030fc53d4 req-3d707342-b310-4b69-bcd5-ebf19b5e3906 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received event network-vif-deleted-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:56:08 user nova-compute[75260]: INFO nova.compute.manager [req-2d051ca7-fc01-43a4-b210-f25030fc53d4 req-3d707342-b310-4b69-bcd5-ebf19b5e3906 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Neutron deleted interface d051edcd-601a-4c12-b8b0-7f1081837279; detaching it from the instance and deleting it from the info cache
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.network.neutron [req-2d051ca7-fc01-43a4-b210-f25030fc53d4 req-3d707342-b310-4b69-bcd5-ebf19b5e3906 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG nova.compute.manager [req-2d051ca7-fc01-43a4-b210-f25030fc53d4 req-3d707342-b310-4b69-bcd5-ebf19b5e3906 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Detach interface failed, port_id=d051edcd-601a-4c12-b8b0-7f1081837279, reason: Instance 60da14c7-b49d-454d-ba99-ec308c4ceb96 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:09 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:56:09 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:56:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:09 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Deleted allocations for instance 60da14c7-b49d-454d-ba99-ec308c4ceb96
Nov 27 04:56:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f9d23604-8c7c-4292-b93b-843ad00587af tempest-TestStampPattern-785030743 tempest-TestStampPattern-785030743-project-member] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.745s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-3dc6aca5-197c-4f01-9e2b-eed865173c1f req-f8e7f7cc-0137-4daf-91e6-bf69a9aa9bc9 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received event network-vif-plugged-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:56:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3dc6aca5-197c-4f01-9e2b-eed865173c1f req-f8e7f7cc-0137-4daf-91e6-bf69a9aa9bc9 service nova] Acquiring lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3dc6aca5-197c-4f01-9e2b-eed865173c1f req-f8e7f7cc-0137-4daf-91e6-bf69a9aa9bc9 service nova] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3dc6aca5-197c-4f01-9e2b-eed865173c1f req-f8e7f7cc-0137-4daf-91e6-bf69a9aa9bc9 service nova] Lock "60da14c7-b49d-454d-ba99-ec308c4ceb96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-3dc6aca5-197c-4f01-9e2b-eed865173c1f req-f8e7f7cc-0137-4daf-91e6-bf69a9aa9bc9 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] No waiting events found dispatching network-vif-plugged-d051edcd-601a-4c12-b8b0-7f1081837279 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:56:09 user nova-compute[75260]: WARNING nova.compute.manager [req-3dc6aca5-197c-4f01-9e2b-eed865173c1f req-f8e7f7cc-0137-4daf-91e6-bf69a9aa9bc9 service nova] [instance: 60da14c7-b49d-454d-ba99-ec308c4ceb96] Received unexpected event network-vif-plugged-d051edcd-601a-4c12-b8b0-7f1081837279 for instance with vm_state deleted and task_state None.
Nov 27 04:56:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:56:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:56:35 user nova-compute[75260]: INFO nova.compute.claims [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Claim successful on node user
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:56:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.policy [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47c5ef7ba8434a4797330f38f74439f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0696f0dfdd40db9b5e8b9aa6397ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:56:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Creating image(s)
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "/opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "/opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk 1073741824" returned: 0 in 0.072s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Successfully created port: 153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:56:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Cannot resize image /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Ensure instance console log exists: /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Successfully updated port: 153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "refresh_cache-0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquired lock "refresh_cache-0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-aba735cd-5cf7-439d-bf51-5a94638059c7 req-48e041af-f2a6-4413-b315-bfba6a0805e2 service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-changed-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-aba735cd-5cf7-439d-bf51-5a94638059c7 req-48e041af-f2a6-4413-b315-bfba6a0805e2 service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Refreshing instance network info cache due to event network-changed-153af088-6d7c-4240-aa51-58e14b7446bc. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-aba735cd-5cf7-439d-bf51-5a94638059c7 req-48e041af-f2a6-4413-b315-bfba6a0805e2 service nova] Acquiring lock "refresh_cache-0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Updating instance_info_cache with network_info: [{"id": "153af088-6d7c-4240-aa51-58e14b7446bc", "address": "fa:16:3e:e6:06:e6", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153af088-6d", "ovs_interfaceid": "153af088-6d7c-4240-aa51-58e14b7446bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Releasing lock "refresh_cache-0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.compute.manager [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Instance network_info: |[{"id": "153af088-6d7c-4240-aa51-58e14b7446bc", "address": "fa:16:3e:e6:06:e6", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153af088-6d", "ovs_interfaceid": "153af088-6d7c-4240-aa51-58e14b7446bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-aba735cd-5cf7-439d-bf51-5a94638059c7 req-48e041af-f2a6-4413-b315-bfba6a0805e2 service nova] Acquired lock "refresh_cache-0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.network.neutron [req-aba735cd-5cf7-439d-bf51-5a94638059c7 req-48e041af-f2a6-4413-b315-bfba6a0805e2 service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Refreshing network info cache for port 153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Start _get_guest_xml network_info=[{"id": "153af088-6d7c-4240-aa51-58e14b7446bc", "address": "fa:16:3e:e6:06:e6", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153af088-6d", "ovs_interfaceid": "153af088-6d7c-4240-aa51-58e14b7446bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:56:37 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:56:37 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1974874179',display_name='tempest-VolumesActionsTest-instance-1974874179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1974874179',id=36,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b0696f0dfdd40db9b5e8b9aa6397ab7',ramdisk_id='',reservation_id='r-ghn5lnzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1777164428',owner_user_name='tempest-VolumesActionsTest-1777164428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:56:36Z,user_data=None,user_id='47c5ef7ba8434a4797330f38f74439f6',uuid=0dfea8aa-6f7f-48e4-a7dd-e227707e02c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "153af088-6d7c-4240-aa51-58e14b7446bc", "address": "fa:16:3e:e6:06:e6", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153af088-6d", "ovs_interfaceid": "153af088-6d7c-4240-aa51-58e14b7446bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converting VIF {"id": "153af088-6d7c-4240-aa51-58e14b7446bc", "address": "fa:16:3e:e6:06:e6", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153af088-6d", "ovs_interfaceid": "153af088-6d7c-4240-aa51-58e14b7446bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:06:e6,bridge_name='br-int',has_traffic_filtering=True,id=153af088-6d7c-4240-aa51-58e14b7446bc,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153af088-6d') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.objects.instance [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:56:37 user nova-compute[75260]:   <uuid>0dfea8aa-6f7f-48e4-a7dd-e227707e02c3</uuid>
Nov 27 04:56:37 user nova-compute[75260]:   <name>instance-00000024</name>
Nov 27 04:56:37 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:56:37 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:56:37 user nova-compute[75260]:   <metadata>
Nov 27 04:56:37 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:56:37 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:56:37 user nova-compute[75260]:       <nova:name>tempest-VolumesActionsTest-instance-1974874179</nova:name>
Nov 27 04:56:37 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:56:37</nova:creationTime>
Nov 27 04:56:37 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:56:37 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:56:37 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:56:37 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:56:37 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:56:37 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:56:37 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:56:37 user nova-compute[75260]:       <nova:owner>
Nov 27 04:56:37 user nova-compute[75260]:         <nova:user uuid="47c5ef7ba8434a4797330f38f74439f6">tempest-VolumesActionsTest-1777164428-project-member</nova:user>
Nov 27 04:56:37 user nova-compute[75260]:         <nova:project uuid="4b0696f0dfdd40db9b5e8b9aa6397ab7">tempest-VolumesActionsTest-1777164428</nova:project>
Nov 27 04:56:37 user nova-compute[75260]:       </nova:owner>
Nov 27 04:56:37 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:56:37 user nova-compute[75260]:       <nova:ports>
Nov 27 04:56:37 user nova-compute[75260]:         <nova:port uuid="153af088-6d7c-4240-aa51-58e14b7446bc">
Nov 27 04:56:37 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 04:56:37 user nova-compute[75260]:         </nova:port>
Nov 27 04:56:37 user nova-compute[75260]:       </nova:ports>
Nov 27 04:56:37 user nova-compute[75260]:     </nova:instance>
Nov 27 04:56:37 user nova-compute[75260]:   </metadata>
Nov 27 04:56:37 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:56:37 user nova-compute[75260]:     <system>
Nov 27 04:56:37 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:56:37 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:56:37 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:56:37 user nova-compute[75260]:       <entry name="serial">0dfea8aa-6f7f-48e4-a7dd-e227707e02c3</entry>
Nov 27 04:56:37 user nova-compute[75260]:       <entry name="uuid">0dfea8aa-6f7f-48e4-a7dd-e227707e02c3</entry>
Nov 27 04:56:37 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:56:37 user nova-compute[75260]:     </system>
Nov 27 04:56:37 user nova-compute[75260]:   </sysinfo>
Nov 27 04:56:37 user nova-compute[75260]:   <os>
Nov 27 04:56:37 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:56:37 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:56:37 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:56:37 user nova-compute[75260]:   </os>
Nov 27 04:56:37 user nova-compute[75260]:   <features>
Nov 27 04:56:37 user nova-compute[75260]:     <acpi/>
Nov 27 04:56:37 user nova-compute[75260]:     <apic/>
Nov 27 04:56:37 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:56:37 user nova-compute[75260]:   </features>
Nov 27 04:56:37 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:56:37 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:56:37 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:56:37 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:56:37 user nova-compute[75260]:   </clock>
Nov 27 04:56:37 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:56:37 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:56:37 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:56:37 user nova-compute[75260]:   </cpu>
Nov 27 04:56:37 user nova-compute[75260]:   <devices>
Nov 27 04:56:37 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:56:37 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:56:37 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk"/>
Nov 27 04:56:37 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:56:37 user nova-compute[75260]:     </disk>
Nov 27 04:56:37 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:56:37 user nova-compute[75260]:       <mac address="fa:16:3e:e6:06:e6"/>
Nov 27 04:56:37 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:56:37 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:56:37 user nova-compute[75260]:       <target dev="tap153af088-6d"/>
Nov 27 04:56:37 user nova-compute[75260]:     </interface>
Nov 27 04:56:37 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:56:37 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/console.log" append="off"/>
Nov 27 04:56:37 user nova-compute[75260]:     </serial>
Nov 27 04:56:37 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:56:37 user nova-compute[75260]:     <video>
Nov 27 04:56:37 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:56:37 user nova-compute[75260]:     </video>
Nov 27 04:56:37 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:56:37 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:56:37 user nova-compute[75260]:     </rng>
Nov 27 04:56:37 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:56:37 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:56:37 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:56:37 user nova-compute[75260]:     </memballoon>
Nov 27 04:56:37 user nova-compute[75260]:   </devices>
Nov 27 04:56:37 user nova-compute[75260]: </domain>
Nov 27 04:56:37 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1974874179',display_name='tempest-VolumesActionsTest-instance-1974874179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1974874179',id=36,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b0696f0dfdd40db9b5e8b9aa6397ab7',ramdisk_id='',reservation_id='r-ghn5lnzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1777164428',owner_user_name='tempest-VolumesActionsTest-1777164428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:56:36Z,user_data=None,user_id='47c5ef7ba8434a4797330f38f74439f6',uuid=0dfea8aa-6f7f-48e4-a7dd-e227707e02c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "153af088-6d7c-4240-aa51-58e14b7446bc", "address": "fa:16:3e:e6:06:e6", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153af088-6d", "ovs_interfaceid": "153af088-6d7c-4240-aa51-58e14b7446bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converting VIF {"id": "153af088-6d7c-4240-aa51-58e14b7446bc", "address": "fa:16:3e:e6:06:e6", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153af088-6d", "ovs_interfaceid": "153af088-6d7c-4240-aa51-58e14b7446bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:06:e6,bridge_name='br-int',has_traffic_filtering=True,id=153af088-6d7c-4240-aa51-58e14b7446bc,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153af088-6d') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG os_vif [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:06:e6,bridge_name='br-int',has_traffic_filtering=True,id=153af088-6d7c-4240-aa51-58e14b7446bc,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153af088-6d') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '387500a9-e09d-585a-83a1-96dc96a02962', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap153af088-6d, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap153af088-6d, col_values=(('qos', UUID('5047771f-1db1-4b03-b00a-471b78d6a054')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap153af088-6d, col_values=(('external_ids', {'iface-id': '153af088-6d7c-4240-aa51-58e14b7446bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:06:e6', 'vm-uuid': '0dfea8aa-6f7f-48e4-a7dd-e227707e02c3'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:56:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:37 user nova-compute[75260]: INFO os_vif [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:06:e6,bridge_name='br-int',has_traffic_filtering=True,id=153af088-6d7c-4240-aa51-58e14b7446bc,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153af088-6d')
Nov 27 04:56:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:56:38 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] No VIF found with MAC fa:16:3e:e6:06:e6, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:56:38 user nova-compute[75260]: DEBUG nova.network.neutron [req-aba735cd-5cf7-439d-bf51-5a94638059c7 req-48e041af-f2a6-4413-b315-bfba6a0805e2 service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Updated VIF entry in instance network info cache for port 153af088-6d7c-4240-aa51-58e14b7446bc. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:56:38 user nova-compute[75260]: DEBUG nova.network.neutron [req-aba735cd-5cf7-439d-bf51-5a94638059c7 req-48e041af-f2a6-4413-b315-bfba6a0805e2 service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Updating instance_info_cache with network_info: [{"id": "153af088-6d7c-4240-aa51-58e14b7446bc", "address": "fa:16:3e:e6:06:e6", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153af088-6d", "ovs_interfaceid": "153af088-6d7c-4240-aa51-58e14b7446bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:56:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-aba735cd-5cf7-439d-bf51-5a94638059c7 req-48e041af-f2a6-4413-b315-bfba6a0805e2 service nova] Releasing lock "refresh_cache-0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:56:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c9575c4-c605-40c2-a4b3-fcd521b14688 req-9c98f7ac-b622-4f35-b109-36f72837fad7 service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:56:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c9575c4-c605-40c2-a4b3-fcd521b14688 req-9c98f7ac-b622-4f35-b109-36f72837fad7 service nova] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c9575c4-c605-40c2-a4b3-fcd521b14688 req-9c98f7ac-b622-4f35-b109-36f72837fad7 service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c9575c4-c605-40c2-a4b3-fcd521b14688 req-9c98f7ac-b622-4f35-b109-36f72837fad7 service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c9575c4-c605-40c2-a4b3-fcd521b14688 req-9c98f7ac-b622-4f35-b109-36f72837fad7 service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] No waiting events found dispatching network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:56:39 user nova-compute[75260]: WARNING nova.compute.manager [req-4c9575c4-c605-40c2-a4b3-fcd521b14688 req-9c98f7ac-b622-4f35-b109-36f72837fad7 service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received unexpected event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc for instance with vm_state building and task_state spawning.
Nov 27 04:56:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.compute.manager [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:56:41 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Instance spawned successfully.
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:56:41 user nova-compute[75260]: INFO nova.compute.manager [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.compute.manager [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:56:41 user nova-compute[75260]: INFO nova.compute.manager [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Took 5.93 seconds to build instance.
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-368d2d31-d741-4ba3-a3d9-5519b0b0ebc9 req-6447cce3-a53e-4e96-ab36-d76d52ac975b service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-368d2d31-d741-4ba3-a3d9-5519b0b0ebc9 req-6447cce3-a53e-4e96-ab36-d76d52ac975b service nova] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-368d2d31-d741-4ba3-a3d9-5519b0b0ebc9 req-6447cce3-a53e-4e96-ab36-d76d52ac975b service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-368d2d31-d741-4ba3-a3d9-5519b0b0ebc9 req-6447cce3-a53e-4e96-ab36-d76d52ac975b service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-368d2d31-d741-4ba3-a3d9-5519b0b0ebc9 req-6447cce3-a53e-4e96-ab36-d76d52ac975b service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] No waiting events found dispatching network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:56:41 user nova-compute[75260]: WARNING nova.compute.manager [req-368d2d31-d741-4ba3-a3d9-5519b0b0ebc9 req-6447cce3-a53e-4e96-ab36-d76d52ac975b service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received unexpected event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc for instance with vm_state active and task_state None.
Nov 27 04:56:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39581970-64be-4d58-9305-557528ca43ea tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.053s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-b9b6f504-8ede-4d5c-afa1-6cbeb688b4e2 req-587964bc-619d-41e1-bf2c-72121d958d6d service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-changed-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:56:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-b9b6f504-8ede-4d5c-afa1-6cbeb688b4e2 req-587964bc-619d-41e1-bf2c-72121d958d6d service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Refreshing instance network info cache due to event network-changed-644a8370-b874-4106-afb9-751704c5e737. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:56:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b9b6f504-8ede-4d5c-afa1-6cbeb688b4e2 req-587964bc-619d-41e1-bf2c-72121d958d6d service nova] Acquiring lock "refresh_cache-49bed705-0bcf-41aa-9acc-a8117d4d47b0" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:56:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b9b6f504-8ede-4d5c-afa1-6cbeb688b4e2 req-587964bc-619d-41e1-bf2c-72121d958d6d service nova] Acquired lock "refresh_cache-49bed705-0bcf-41aa-9acc-a8117d4d47b0" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:56:43 user nova-compute[75260]: DEBUG nova.network.neutron [req-b9b6f504-8ede-4d5c-afa1-6cbeb688b4e2 req-587964bc-619d-41e1-bf2c-72121d958d6d service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Refreshing network info cache for port 644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:56:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-b9b6f504-8ede-4d5c-afa1-6cbeb688b4e2 req-587964bc-619d-41e1-bf2c-72121d958d6d service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Updated VIF entry in instance network info cache for port 644a8370-b874-4106-afb9-751704c5e737. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:56:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-b9b6f504-8ede-4d5c-afa1-6cbeb688b4e2 req-587964bc-619d-41e1-bf2c-72121d958d6d service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Updating instance_info_cache with network_info: [{"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:56:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b9b6f504-8ede-4d5c-afa1-6cbeb688b4e2 req-587964bc-619d-41e1-bf2c-72121d958d6d service nova] Releasing lock "refresh_cache-49bed705-0bcf-41aa-9acc-a8117d4d47b0" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:56:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:44 user nova-compute[75260]: DEBUG nova.objects.instance [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lazy-loading 'flavor' on Instance uuid 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:56:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:44 user nova-compute[75260]: INFO nova.compute.manager [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Attaching volume 810f41f8-8fdc-4121-8b82-6591f565b2fb to /dev/vdb
Nov 27 04:56:45 user nova-compute[75260]: DEBUG os_brick.utils [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9592be3-0d1f-4dde-8cdf-b5fd24a661f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[632fc8d3-b68c-4332-8d19-fe9771d29cbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9131270-de20-4720-b7d2-bce4b64ddb4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4760a42d-82f7-45b5-8d4f-62819c4580ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:56:45 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:56:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a79a3-47fd-4c7e-ab37-bc9dcfa9248c]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG os_brick.utils [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:56:45 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Updating existing volume attachment record: 79e76f78-6033-4d47-afe4-71ba5f91f17e {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:56:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:56:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYFtUPpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:56:51 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:56:51 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:56:51 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fef6bd-729d-43c9-a5cd-2752241d5221]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:56:51 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[380cdf31-6552-4cd8-85af-656fac72d16f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb] added
Nov 27 04:56:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c2b02e-fdd1-40e0-ab04-b663c0d2031d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5c5190-fafa-43f6-8b23-6003c559603b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYFtUPpB {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYFtUPpB" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa6c020-1802-44e2-bd11-be3ba4ccad25]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KYFtUPpB'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd05802-9a36-4dce-af04-b0beb0ef3a80]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf9c571-0eae-4fde-a605-08f6f20ecd8d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:56:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:56:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[013bdcb8-4be2-487e-94a2-0746b9c2f001]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb, portal: 172.16.0.220,3260]
Nov 27 04:56:51 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb, portal: 172.16.0.220,3260] successful.
Nov 27 04:56:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9b0f15-ff2e-4645-a845-fc5888fa1b4a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eea952-bf94-483a-a286-77794b58b030]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:56:51 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:56:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:56:51 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:56:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7312a817-97f1-47f5-b187-00e5cdd47c21]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYFtUPpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:56:51 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23235613766613939', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235613766613939', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG nova.objects.instance [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lazy-loading 'flavor' on Instance uuid 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:56:52 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:56:52 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:56:52 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:56:52 user nova-compute[75260]:   <serial>810f41f8-8fdc-4121-8b82-6591f565b2fb</serial>
Nov 27 04:56:52 user nova-compute[75260]: </disk>
Nov 27 04:56:52 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:56:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:56:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:56:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:56:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] No VIF found with MAC fa:16:3e:f6:af:22, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:56:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-241bf58f-efb0-47e3-8311-faae1aa1a618 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.461s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updating instance_info_cache with network_info: [{"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:56:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:56:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:56:53 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:56:53 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:56:54 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:56:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:56:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:55 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG nova.objects.instance [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lazy-loading 'flavor' on Instance uuid 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:56 user nova-compute[75260]: INFO nova.compute.manager [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Attaching volume b7414f8f-e014-43f2-a983-6edf921cc445 to /dev/vdc
Nov 27 04:56:56 user nova-compute[75260]: DEBUG os_brick.utils [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[da50c6be-afe2-4090-9358-1bd36a235482]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5438b6f-aca1-4c1e-91e0-6b413ce9b99a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ed04d-fd55-4373-9f21-ca064e7dee49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e410db9-09e3-449e-b5d9-b122663ad0e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:56:56 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e774cb6c-b5e2-4be9-87e9-9c9be93b7104]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG os_brick.utils [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Updating existing volume attachment record: 444b2b88-2e53-4d08-9dd2-3f5128b15907 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:56 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:56:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:56:58 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:56:58 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8268MB free_disk=25.279949188232422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance ed53fa6e-6fef-4293-b51c-989e7b343e94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:56:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:57:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:57:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADdObHRY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:57:03 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:57:03 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:57:03 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c167e72-28db-449b-9338-395ab012973f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:57:03 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417972e-853f-44d8-9cfa-5cde7154bbc2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445] added
Nov 27 04:57:03 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e5075-6388-4c1d-8881-6f2f41b9ffe1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6559f836-8a20-4e15-bed6-cdfd0a0e10cf]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADdObHRY {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADdObHRY" returned: 0 in 0.115s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff040b5-c01a-4a0a-9e03-4acb6ef57b18]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ADdObHRY'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3346c79-55f4-47cb-904f-3a821ac2779f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e538234e-aba5-4c56-821c-6e4100862031]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:04 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:04 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:04 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:04 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6e8324-e95f-4450-9df7-a55332476717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445, portal: 172.16.0.220,3260]
Nov 27 04:57:04 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445, portal: 172.16.0.220,3260] successful.
Nov 27 04:57:04 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d67f1d1-9fb8-4c05-aa6e-3e4e4718bc48]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b39373-2801-4753-b05b-2a51d228759f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:04 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:04 user nova-compute[75260]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)
Nov 27 04:57:04 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:04 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:04 user nova-compute[75260]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)
Nov 27 04:57:04 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.531s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee784648-af0a-4667-be59-c3b6b3658371]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADdObHRY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-55a8e4e2-50de-4fa6-a492-480655ae770f req-c395be15-d6c3-4f2c-bdd0-ba916b918644 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received event network-changed-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-55a8e4e2-50de-4fa6-a492-480655ae770f req-c395be15-d6c3-4f2c-bdd0-ba916b918644 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Refreshing instance network info cache due to event network-changed-c8b85997-6458-4494-8d0c-a9b3e3cc3b15. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-55a8e4e2-50de-4fa6-a492-480655ae770f req-c395be15-d6c3-4f2c-bdd0-ba916b918644 service nova] Acquiring lock "refresh_cache-ed53fa6e-6fef-4293-b51c-989e7b343e94" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-55a8e4e2-50de-4fa6-a492-480655ae770f req-c395be15-d6c3-4f2c-bdd0-ba916b918644 service nova] Acquired lock "refresh_cache-ed53fa6e-6fef-4293-b51c-989e7b343e94" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG nova.network.neutron [req-55a8e4e2-50de-4fa6-a492-480655ae770f req-c395be15-d6c3-4f2c-bdd0-ba916b918644 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Refreshing network info cache for port c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG nova.objects.instance [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lazy-loading 'flavor' on Instance uuid ed53fa6e-6fef-4293-b51c-989e7b343e94 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:57:04 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Ignoring supplied device name: /dev/vdb
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:04 user nova-compute[75260]: INFO nova.compute.manager [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Attaching volume 68bbc192-e10f-4ccb-b7a8-266f3ff39172 to /dev/vdb
Nov 27 04:57:04 user nova-compute[75260]: DEBUG os_brick.utils [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03edf7f-f9e6-4417-8ad0-a07e6095eba1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d369e-68c5-4e44-9e8d-e3706b43fc9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae44826-126b-45ea-b83e-0cb31d57511d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[88458226-15f4-4527-9729-25ef97e12aa9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:57:05 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:57:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56dd456-4f86-49e0-8db5-e145ce3768c3]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG os_brick.utils [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Updating existing volume attachment record: cd7a06dd-18ce-496d-9dbd-162fa52dab8f {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG nova.network.neutron [req-55a8e4e2-50de-4fa6-a492-480655ae770f req-c395be15-d6c3-4f2c-bdd0-ba916b918644 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Updated VIF entry in instance network info cache for port c8b85997-6458-4494-8d0c-a9b3e3cc3b15. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG nova.network.neutron [req-55a8e4e2-50de-4fa6-a492-480655ae770f req-c395be15-d6c3-4f2c-bdd0-ba916b918644 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Updating instance_info_cache with network_info: [{"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.827s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] <== connect_volume: return (1829ms) {'type': 'block', 'scsi_wwn': '26561376363363636', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561376363363636', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG nova.objects.instance [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lazy-loading 'flavor' on Instance uuid 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-55a8e4e2-50de-4fa6-a492-480655ae770f req-c395be15-d6c3-4f2c-bdd0-ba916b918644 service nova] Releasing lock "refresh_cache-ed53fa6e-6fef-4293-b51c-989e7b343e94" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:57:05 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:57:05 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:57:05 user nova-compute[75260]:   <target dev="vdc" bus="virtio"/>
Nov 27 04:57:05 user nova-compute[75260]:   <serial>b7414f8f-e014-43f2-a983-6edf921cc445</serial>
Nov 27 04:57:05 user nova-compute[75260]: </disk>
Nov 27 04:57:05 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:57:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] No VIF found with MAC fa:16:3e:f6:af:22, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:57:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-88178e9f-dd6e-41f5-abaf-d7973acac365 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.414s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:06 user nova-compute[75260]: INFO nova.compute.manager [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Detaching volume b7414f8f-e014-43f2-a983-6edf921cc445
Nov 27 04:57:06 user nova-compute[75260]: INFO nova.virt.block_device [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Attempting to driver detach volume b7414f8f-e014-43f2-a983-6edf921cc445 from mountpoint /dev/vdc
Nov 27 04:57:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Attempting to detach device vdc from instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:57:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:57:06 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:57:06 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:57:06 user nova-compute[75260]:   <target dev="vdc" bus="virtio"/>
Nov 27 04:57:06 user nova-compute[75260]:   <serial>b7414f8f-e014-43f2-a983-6edf921cc445</serial>
Nov 27 04:57:06 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 04:57:06 user nova-compute[75260]: </disk>
Nov 27 04:57:06 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:57:06 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Successfully detached device vdc from instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 from the persistent domain config.
Nov 27 04:57:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:57:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:57:06 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:57:06 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 04:57:06 user nova-compute[75260]:   <target dev="vdc" bus="virtio"/>
Nov 27 04:57:06 user nova-compute[75260]:   <serial>b7414f8f-e014-43f2-a983-6edf921cc445</serial>
Nov 27 04:57:06 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 04:57:06 user nova-compute[75260]: </disk>
Nov 27 04:57:06 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:57:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:57:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRWzbTIe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:57:11 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:57:11 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:57:11 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ea464c-d240-4e03-b494-9c07675d52b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:57:11 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[782eb906-aca8-43a2-a829-c24d93cbd33f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172] added
Nov 27 04:57:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdb1823-380a-4137-a24f-c8d03ac992c4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e36d3c2-2b99-4462-9f7e-c99c34507f2e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRWzbTIe {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRWzbTIe" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[275ffb19-e7f5-48f6-97e8-0e4c7d0398aa]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QRWzbTIe'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ce4865-1b9f-4c87-b921-afdece51c6f3]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1f828d-9412-4b56-a24b-cf1f3bf4e5ea]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:11 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:11 user nova-compute[75260]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)
Nov 27 04:57:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:11 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:11 user nova-compute[75260]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)
Nov 27 04:57:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c856b04b-72c0-44c9-b9e1-8540c9ae895c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172, portal: 172.16.0.220,3260]
Nov 27 04:57:11 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172, portal: 172.16.0.220,3260] successful.
Nov 27 04:57:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8299ed-b2f5-468b-9dae-daf1b9728452]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c651b1-11c4-4e9c-809b-a3f7d5beacb5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:11 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:11 user nova-compute[75260]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)
Nov 27 04:57:11 user nova-compute[75260]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 (non-flash)
Nov 27 04:57:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:11 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:11 user nova-compute[75260]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)
Nov 27 04:57:11 user nova-compute[75260]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 (non-flash)
Nov 27 04:57:11 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ab8537-bf40-4526-96ac-95d4fa9c1837]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:57:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRWzbTIe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:57:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:57:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26262613630353361', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:57:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262613630353361', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:57:12 user nova-compute[75260]: DEBUG nova.objects.instance [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lazy-loading 'flavor' on Instance uuid ed53fa6e-6fef-4293-b51c-989e7b343e94 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:57:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:57:12 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:57:12 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:57:12 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:57:12 user nova-compute[75260]:   <serial>68bbc192-e10f-4ccb-b7a8-266f3ff39172</serial>
Nov 27 04:57:12 user nova-compute[75260]: </disk>
Nov 27 04:57:12 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:57:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:57:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:57:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] No VIF found with MAC fa:16:3e:50:c9:a7, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:57:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-69d68ba6-2f58-49da-ba66-dbed418ce830 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.759s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "1a25081f-79d1-412f-bf99-4235516d40a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1a25081f-79d1-412f-bf99-4235516d40a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:57:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:57:14 user nova-compute[75260]: INFO nova.compute.claims [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Claim successful on node user
Nov 27 04:57:14 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:57:14 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:57:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:57:15 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:57:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG nova.policy [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05cdf3b00bfe4f728e7fa4e17eba3c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eada319615449deb2152f59ba3d3e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:57:15 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Creating image(s)
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "/opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "/opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.237s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk 1073741824" returned: 0 in 0.106s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Successfully created port: 36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.212s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:57:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Cannot resize image /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Ensure instance console log exists: /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG nova.network.neutron [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Successfully updated port: 36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "refresh_cache-1a25081f-79d1-412f-bf99-4235516d40a6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquired lock "refresh_cache-1a25081f-79d1-412f-bf99-4235516d40a6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG nova.network.neutron [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-1c81f722-8621-49e9-8e92-e3a1ffacdb40 req-79a7ee9a-4864-4be3-906b-8819d7159394 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Received event network-changed-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-1c81f722-8621-49e9-8e92-e3a1ffacdb40 req-79a7ee9a-4864-4be3-906b-8819d7159394 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Refreshing instance network info cache due to event network-changed-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1c81f722-8621-49e9-8e92-e3a1ffacdb40 req-79a7ee9a-4864-4be3-906b-8819d7159394 service nova] Acquiring lock "refresh_cache-1a25081f-79d1-412f-bf99-4235516d40a6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:57:16 user nova-compute[75260]: DEBUG nova.network.neutron [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.network.neutron [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Updating instance_info_cache with network_info: [{"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Releasing lock "refresh_cache-1a25081f-79d1-412f-bf99-4235516d40a6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.compute.manager [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Instance network_info: |[{"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1c81f722-8621-49e9-8e92-e3a1ffacdb40 req-79a7ee9a-4864-4be3-906b-8819d7159394 service nova] Acquired lock "refresh_cache-1a25081f-79d1-412f-bf99-4235516d40a6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.network.neutron [req-1c81f722-8621-49e9-8e92-e3a1ffacdb40 req-79a7ee9a-4864-4be3-906b-8819d7159394 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Refreshing network info cache for port 36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Start _get_guest_xml network_info=[{"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:57:17 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:57:17 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1130073666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1130073666',id=37,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-pvf4xr21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:57:15Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=1a25081f-79d1-412f-bf99-4235516d40a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:49:d7,bridge_name='br-int',has_traffic_filtering=True,id=36cb7cdc-1e5a-475f-b055-b06a2c0c7a27,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36cb7cdc-1e') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.objects.instance [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a25081f-79d1-412f-bf99-4235516d40a6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:57:17 user nova-compute[75260]:   <uuid>1a25081f-79d1-412f-bf99-4235516d40a6</uuid>
Nov 27 04:57:17 user nova-compute[75260]:   <name>instance-00000025</name>
Nov 27 04:57:17 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:57:17 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:57:17 user nova-compute[75260]:   <metadata>
Nov 27 04:57:17 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:57:17 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:57:17 user nova-compute[75260]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1130073666</nova:name>
Nov 27 04:57:17 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:57:17</nova:creationTime>
Nov 27 04:57:17 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:57:17 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:57:17 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:57:17 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:57:17 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:57:17 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:57:17 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:57:17 user nova-compute[75260]:       <nova:owner>
Nov 27 04:57:17 user nova-compute[75260]:         <nova:user uuid="05cdf3b00bfe4f728e7fa4e17eba3c4e">tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member</nova:user>
Nov 27 04:57:17 user nova-compute[75260]:         <nova:project uuid="7eada319615449deb2152f59ba3d3e6d">tempest-ServerBootFromVolumeStableRescueTest-293744143</nova:project>
Nov 27 04:57:17 user nova-compute[75260]:       </nova:owner>
Nov 27 04:57:17 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:57:17 user nova-compute[75260]:       <nova:ports>
Nov 27 04:57:17 user nova-compute[75260]:         <nova:port uuid="36cb7cdc-1e5a-475f-b055-b06a2c0c7a27">
Nov 27 04:57:17 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 04:57:17 user nova-compute[75260]:         </nova:port>
Nov 27 04:57:17 user nova-compute[75260]:       </nova:ports>
Nov 27 04:57:17 user nova-compute[75260]:     </nova:instance>
Nov 27 04:57:17 user nova-compute[75260]:   </metadata>
Nov 27 04:57:17 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:57:17 user nova-compute[75260]:     <system>
Nov 27 04:57:17 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:57:17 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:57:17 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:57:17 user nova-compute[75260]:       <entry name="serial">1a25081f-79d1-412f-bf99-4235516d40a6</entry>
Nov 27 04:57:17 user nova-compute[75260]:       <entry name="uuid">1a25081f-79d1-412f-bf99-4235516d40a6</entry>
Nov 27 04:57:17 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:57:17 user nova-compute[75260]:     </system>
Nov 27 04:57:17 user nova-compute[75260]:   </sysinfo>
Nov 27 04:57:17 user nova-compute[75260]:   <os>
Nov 27 04:57:17 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:57:17 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:57:17 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:57:17 user nova-compute[75260]:   </os>
Nov 27 04:57:17 user nova-compute[75260]:   <features>
Nov 27 04:57:17 user nova-compute[75260]:     <acpi/>
Nov 27 04:57:17 user nova-compute[75260]:     <apic/>
Nov 27 04:57:17 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:57:17 user nova-compute[75260]:   </features>
Nov 27 04:57:17 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:57:17 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:57:17 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:57:17 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:57:17 user nova-compute[75260]:   </clock>
Nov 27 04:57:17 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:57:17 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:57:17 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:57:17 user nova-compute[75260]:   </cpu>
Nov 27 04:57:17 user nova-compute[75260]:   <devices>
Nov 27 04:57:17 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:57:17 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:57:17 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk"/>
Nov 27 04:57:17 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:57:17 user nova-compute[75260]:     </disk>
Nov 27 04:57:17 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:57:17 user nova-compute[75260]:       <mac address="fa:16:3e:be:49:d7"/>
Nov 27 04:57:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:57:17 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:57:17 user nova-compute[75260]:       <target dev="tap36cb7cdc-1e"/>
Nov 27 04:57:17 user nova-compute[75260]:     </interface>
Nov 27 04:57:17 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:57:17 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/console.log" append="off"/>
Nov 27 04:57:17 user nova-compute[75260]:     </serial>
Nov 27 04:57:17 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:57:17 user nova-compute[75260]:     <video>
Nov 27 04:57:17 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:57:17 user nova-compute[75260]:     </video>
Nov 27 04:57:17 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:57:17 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:57:17 user nova-compute[75260]:     </rng>
Nov 27 04:57:17 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:57:17 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:57:17 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:57:17 user nova-compute[75260]:     </memballoon>
Nov 27 04:57:17 user nova-compute[75260]:   </devices>
Nov 27 04:57:17 user nova-compute[75260]: </domain>
Nov 27 04:57:17 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1130073666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1130073666',id=37,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-pvf4xr21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:57:15Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=1a25081f-79d1-412f-bf99-4235516d40a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:49:d7,bridge_name='br-int',has_traffic_filtering=True,id=36cb7cdc-1e5a-475f-b055-b06a2c0c7a27,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36cb7cdc-1e') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG os_vif [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:49:d7,bridge_name='br-int',has_traffic_filtering=True,id=36cb7cdc-1e5a-475f-b055-b06a2c0c7a27,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36cb7cdc-1e') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ffc668c-3075-5bdd-8de4-cf6cfabe95c3', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36cb7cdc-1e, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36cb7cdc-1e, col_values=(('qos', UUID('5bd3e01b-7bdc-4f34-9dba-23703f4aebde')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36cb7cdc-1e, col_values=(('external_ids', {'iface-id': '36cb7cdc-1e5a-475f-b055-b06a2c0c7a27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:49:d7', 'vm-uuid': '1a25081f-79d1-412f-bf99-4235516d40a6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:17 user nova-compute[75260]: INFO os_vif [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:49:d7,bridge_name='br-int',has_traffic_filtering=True,id=36cb7cdc-1e5a-475f-b055-b06a2c0c7a27,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36cb7cdc-1e')
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No VIF found with MAC fa:16:3e:be:49:d7, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.network.neutron [req-1c81f722-8621-49e9-8e92-e3a1ffacdb40 req-79a7ee9a-4864-4be3-906b-8819d7159394 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Updated VIF entry in instance network info cache for port 36cb7cdc-1e5a-475f-b055-b06a2c0c7a27. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG nova.network.neutron [req-1c81f722-8621-49e9-8e92-e3a1ffacdb40 req-79a7ee9a-4864-4be3-906b-8819d7159394 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Updating instance_info_cache with network_info: [{"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:57:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1c81f722-8621-49e9-8e92-e3a1ffacdb40 req-79a7ee9a-4864-4be3-906b-8819d7159394 service nova] Releasing lock "refresh_cache-1a25081f-79d1-412f-bf99-4235516d40a6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:57:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:18 user nova-compute[75260]: DEBUG nova.compute.manager [req-7c455373-b68a-4428-beff-6e082e756583 req-a62c14a9-afe4-4738-bda5-3a9ccc1db87b service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Received event network-vif-plugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7c455373-b68a-4428-beff-6e082e756583 req-a62c14a9-afe4-4738-bda5-3a9ccc1db87b service nova] Acquiring lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7c455373-b68a-4428-beff-6e082e756583 req-a62c14a9-afe4-4738-bda5-3a9ccc1db87b service nova] Lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7c455373-b68a-4428-beff-6e082e756583 req-a62c14a9-afe4-4738-bda5-3a9ccc1db87b service nova] Lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:18 user nova-compute[75260]: DEBUG nova.compute.manager [req-7c455373-b68a-4428-beff-6e082e756583 req-a62c14a9-afe4-4738-bda5-3a9ccc1db87b service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] No waiting events found dispatching network-vif-plugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:57:18 user nova-compute[75260]: WARNING nova.compute.manager [req-7c455373-b68a-4428-beff-6e082e756583 req-a62c14a9-afe4-4738-bda5-3a9ccc1db87b service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Received unexpected event network-vif-plugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 for instance with vm_state building and task_state spawning.
Nov 27 04:57:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-7ed5926e-64c0-4f2e-ba4f-09f694631db7 req-a1437887-b96d-4835-b9de-f5e131803391 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Received event network-vif-plugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7ed5926e-64c0-4f2e-ba4f-09f694631db7 req-a1437887-b96d-4835-b9de-f5e131803391 service nova] Acquiring lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7ed5926e-64c0-4f2e-ba4f-09f694631db7 req-a1437887-b96d-4835-b9de-f5e131803391 service nova] Lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7ed5926e-64c0-4f2e-ba4f-09f694631db7 req-a1437887-b96d-4835-b9de-f5e131803391 service nova] Lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-7ed5926e-64c0-4f2e-ba4f-09f694631db7 req-a1437887-b96d-4835-b9de-f5e131803391 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] No waiting events found dispatching network-vif-plugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:57:20 user nova-compute[75260]: WARNING nova.compute.manager [req-7ed5926e-64c0-4f2e-ba4f-09f694631db7 req-a1437887-b96d-4835-b9de-f5e131803391 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Received unexpected event network-vif-plugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 for instance with vm_state building and task_state spawning.
Nov 27 04:57:21 user nova-compute[75260]: DEBUG nova.compute.manager [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:57:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:57:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Instance spawned successfully.
Nov 27 04:57:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:57:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:21 user nova-compute[75260]: INFO nova.compute.manager [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 27 04:57:21 user nova-compute[75260]: DEBUG nova.compute.manager [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:57:21 user nova-compute[75260]: INFO nova.compute.manager [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Took 6.69 seconds to build instance.
Nov 27 04:57:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-fb297608-7846-4ecd-82af-288cdac36121 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1a25081f-79d1-412f-bf99-4235516d40a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.794s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:27 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 is timed out.
Nov 27 04:57:27 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Successfully detached device vdc from instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 from the live domain config.
Nov 27 04:57:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADdObHRY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:57:27 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fafa4e9-cf5a-4e3e-a4a2-d49d5e67cb65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:57:27 user nova-compute[75260]: No targets found.
Nov 27 04:57:27 user nova-compute[75260]: iSNS:
Nov 27 04:57:27 user nova-compute[75260]: No targets found.
Nov 27 04:57:27 user nova-compute[75260]: STATIC:
Nov 27 04:57:27 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172
Nov 27 04:57:27 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:57:27 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:57:27 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:57:27 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:57:27 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:57:27 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb
Nov 27 04:57:27 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:57:27 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:57:27 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445
Nov 27 04:57:27 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:57:27 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:57:27 user nova-compute[75260]: FIRMWARE:
Nov 27 04:57:27 user nova-compute[75260]: No targets found.
Nov 27 04:57:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:57:27 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:57:27 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3345f8a-ceff-41ae-b251-ddab310ac914]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[561cfdfe-0512-4787-a3be-c621f3c888b3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:27 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:27 user nova-compute[75260]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)
Nov 27 04:57:27 user nova-compute[75260]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 (non-flash)
Nov 27 04:57:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:27 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:27 user nova-compute[75260]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 (non-flash)
Nov 27 04:57:27 user nova-compute[75260]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 (non-flash)
Nov 27 04:57:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb5410a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9f6df1-1fb4-4330-aa5e-af9397086ce9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a535d82-edfd-4203-a436-14ca46c4836e]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be1a1fb-0a94-411e-a2b3-eef6d95b6e2a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[548b5f99-6ac4-4aea-91f7-017c24c5c47a]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[21608730-bcfc-4758-a462-dadb4fbd0f07]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5899730-a7d1-479e-b48e-3eb7b7357791]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445, portal: 172.16.0.220,3260]
Nov 27 04:57:27 user nova-compute[75260]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445, portal: 172.16.0.220,3260] successful.
Nov 27 04:57:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7414f8f-e014-43f2-a983-6edf921cc445 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[244ab103-cb16-40cf-81bc-ff2fa0b0b6a1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] <== disconnect_volume: return (338ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:57:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:57:28 user nova-compute[75260]: INFO nova.compute.claims [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Claim successful on node user
Nov 27 04:57:28 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lazy-loading 'flavor' on Instance uuid 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2bf44f00-4638-4a59-94ff-52e7efc77a3f tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.701s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:57:28 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:57:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:57:28 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG nova.policy [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5627a212f5a94891a5c90811cffbcb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b409ff46f9cd4a769e77b24b7273e921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:57:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Creating image(s)
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "/opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "/opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.203s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk 1073741824" returned: 0 in 0.055s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Successfully created port: 1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.237s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:57:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Cannot resize image /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Ensure instance console log exists: /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Successfully updated port: 1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquired lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-fd8f2809-4c23-4c5b-8050-27dd8f6f55c9 req-d62d69c6-0e79-42d0-bce6-98a6a4267a1a service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-changed-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-fd8f2809-4c23-4c5b-8050-27dd8f6f55c9 req-d62d69c6-0e79-42d0-bce6-98a6a4267a1a service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Refreshing instance network info cache due to event network-changed-1cac0fe3-e9cf-4557-a30d-8182575753cd. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fd8f2809-4c23-4c5b-8050-27dd8f6f55c9 req-d62d69c6-0e79-42d0-bce6-98a6a4267a1a service nova] Acquiring lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updating instance_info_cache with network_info: [{"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Releasing lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Instance network_info: |[{"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fd8f2809-4c23-4c5b-8050-27dd8f6f55c9 req-d62d69c6-0e79-42d0-bce6-98a6a4267a1a service nova] Acquired lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.network.neutron [req-fd8f2809-4c23-4c5b-8050-27dd8f6f55c9 req-d62d69c6-0e79-42d0-bce6-98a6a4267a1a service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Refreshing network info cache for port 1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Start _get_guest_xml network_info=[{"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:57:30 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:57:30 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2079771585',display_name='tempest-SnapshotDataIntegrityTests-server-2079771585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2079771585',id=38,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGfiekAeXvgi87pSAzZd6whmDDd7bDfEO+/NumlFGy4xCwbIrJLHiuHCSz4HNHZug1RjAgIxYirr1+PtEXSK7+Mx3m+zeLwG1GHkzRHltHkM6aeskPMZ2sman6JmXhV8g==',key_name='tempest-keypair-1713085007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b409ff46f9cd4a769e77b24b7273e921',ramdisk_id='',reservation_id='r-1dy3bzc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1092427161',owner_user_name='tempest-SnapshotDataIntegrityTests-1092427161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:57:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5627a212f5a94891a5c90811cffbcb66',uuid=4bff94d1-4400-4dff-baff-fc10c8070b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Converting VIF {"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:c4:7b,bridge_name='br-int',has_traffic_filtering=True,id=1cac0fe3-e9cf-4557-a30d-8182575753cd,network=Network(9db38faa-e099-4d3c-bbad-b2a54391506c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cac0fe3-e9') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.objects.instance [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:57:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:57:30 user nova-compute[75260]:   <uuid>4bff94d1-4400-4dff-baff-fc10c8070b05</uuid>
Nov 27 04:57:30 user nova-compute[75260]:   <name>instance-00000026</name>
Nov 27 04:57:30 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:57:30 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:57:30 user nova-compute[75260]:   <metadata>
Nov 27 04:57:30 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:57:30 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:57:30 user nova-compute[75260]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2079771585</nova:name>
Nov 27 04:57:30 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:57:30</nova:creationTime>
Nov 27 04:57:30 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:57:30 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:57:30 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:57:30 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:57:30 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:57:30 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:57:30 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:57:30 user nova-compute[75260]:       <nova:owner>
Nov 27 04:57:30 user nova-compute[75260]:         <nova:user uuid="5627a212f5a94891a5c90811cffbcb66">tempest-SnapshotDataIntegrityTests-1092427161-project-member</nova:user>
Nov 27 04:57:30 user nova-compute[75260]:         <nova:project uuid="b409ff46f9cd4a769e77b24b7273e921">tempest-SnapshotDataIntegrityTests-1092427161</nova:project>
Nov 27 04:57:30 user nova-compute[75260]:       </nova:owner>
Nov 27 04:57:30 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:57:30 user nova-compute[75260]:       <nova:ports>
Nov 27 04:57:30 user nova-compute[75260]:         <nova:port uuid="1cac0fe3-e9cf-4557-a30d-8182575753cd">
Nov 27 04:57:30 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 04:57:30 user nova-compute[75260]:         </nova:port>
Nov 27 04:57:30 user nova-compute[75260]:       </nova:ports>
Nov 27 04:57:30 user nova-compute[75260]:     </nova:instance>
Nov 27 04:57:30 user nova-compute[75260]:   </metadata>
Nov 27 04:57:30 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:57:30 user nova-compute[75260]:     <system>
Nov 27 04:57:30 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:57:30 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:57:30 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:57:30 user nova-compute[75260]:       <entry name="serial">4bff94d1-4400-4dff-baff-fc10c8070b05</entry>
Nov 27 04:57:30 user nova-compute[75260]:       <entry name="uuid">4bff94d1-4400-4dff-baff-fc10c8070b05</entry>
Nov 27 04:57:30 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:57:30 user nova-compute[75260]:     </system>
Nov 27 04:57:30 user nova-compute[75260]:   </sysinfo>
Nov 27 04:57:30 user nova-compute[75260]:   <os>
Nov 27 04:57:30 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:57:30 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:57:30 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:57:30 user nova-compute[75260]:   </os>
Nov 27 04:57:30 user nova-compute[75260]:   <features>
Nov 27 04:57:30 user nova-compute[75260]:     <acpi/>
Nov 27 04:57:30 user nova-compute[75260]:     <apic/>
Nov 27 04:57:30 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:57:30 user nova-compute[75260]:   </features>
Nov 27 04:57:30 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:57:30 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:57:30 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:57:30 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:57:30 user nova-compute[75260]:   </clock>
Nov 27 04:57:30 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:57:30 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:57:30 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:57:30 user nova-compute[75260]:   </cpu>
Nov 27 04:57:30 user nova-compute[75260]:   <devices>
Nov 27 04:57:30 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:57:30 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:57:30 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk"/>
Nov 27 04:57:30 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:57:30 user nova-compute[75260]:     </disk>
Nov 27 04:57:30 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:57:30 user nova-compute[75260]:       <mac address="fa:16:3e:12:c4:7b"/>
Nov 27 04:57:30 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:57:30 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:57:30 user nova-compute[75260]:       <target dev="tap1cac0fe3-e9"/>
Nov 27 04:57:30 user nova-compute[75260]:     </interface>
Nov 27 04:57:30 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:57:30 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/console.log" append="off"/>
Nov 27 04:57:30 user nova-compute[75260]:     </serial>
Nov 27 04:57:30 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:57:30 user nova-compute[75260]:     <video>
Nov 27 04:57:30 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:57:30 user nova-compute[75260]:     </video>
Nov 27 04:57:30 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:57:30 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:57:30 user nova-compute[75260]:     </rng>
Nov 27 04:57:30 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:57:30 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:57:30 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:57:30 user nova-compute[75260]:     </memballoon>
Nov 27 04:57:30 user nova-compute[75260]:   </devices>
Nov 27 04:57:30 user nova-compute[75260]: </domain>
Nov 27 04:57:30 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2079771585',display_name='tempest-SnapshotDataIntegrityTests-server-2079771585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2079771585',id=38,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGfiekAeXvgi87pSAzZd6whmDDd7bDfEO+/NumlFGy4xCwbIrJLHiuHCSz4HNHZug1RjAgIxYirr1+PtEXSK7+Mx3m+zeLwG1GHkzRHltHkM6aeskPMZ2sman6JmXhV8g==',key_name='tempest-keypair-1713085007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b409ff46f9cd4a769e77b24b7273e921',ramdisk_id='',reservation_id='r-1dy3bzc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1092427161',owner_user_name='tempest-SnapshotDataIntegrityTests-1092427161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:57:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5627a212f5a94891a5c90811cffbcb66',uuid=4bff94d1-4400-4dff-baff-fc10c8070b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Converting VIF {"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:c4:7b,bridge_name='br-int',has_traffic_filtering=True,id=1cac0fe3-e9cf-4557-a30d-8182575753cd,network=Network(9db38faa-e099-4d3c-bbad-b2a54391506c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cac0fe3-e9') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG os_vif [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c4:7b,bridge_name='br-int',has_traffic_filtering=True,id=1cac0fe3-e9cf-4557-a30d-8182575753cd,network=Network(9db38faa-e099-4d3c-bbad-b2a54391506c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cac0fe3-e9') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2c9824a-39d9-5dc0-9b61-8d34c89b4b34', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cac0fe3-e9, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1cac0fe3-e9, col_values=(('qos', UUID('2f94e268-7415-44a0-87a0-59d0e5cd7c27')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1cac0fe3-e9, col_values=(('external_ids', {'iface-id': '1cac0fe3-e9cf-4557-a30d-8182575753cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:c4:7b', 'vm-uuid': '4bff94d1-4400-4dff-baff-fc10c8070b05'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:31 user nova-compute[75260]: INFO os_vif [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c4:7b,bridge_name='br-int',has_traffic_filtering=True,id=1cac0fe3-e9cf-4557-a30d-8182575753cd,network=Network(9db38faa-e099-4d3c-bbad-b2a54391506c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cac0fe3-e9')
Nov 27 04:57:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No VIF found with MAC fa:16:3e:12:c4:7b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG nova.network.neutron [req-fd8f2809-4c23-4c5b-8050-27dd8f6f55c9 req-d62d69c6-0e79-42d0-bce6-98a6a4267a1a service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updated VIF entry in instance network info cache for port 1cac0fe3-e9cf-4557-a30d-8182575753cd. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG nova.network.neutron [req-fd8f2809-4c23-4c5b-8050-27dd8f6f55c9 req-d62d69c6-0e79-42d0-bce6-98a6a4267a1a service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updating instance_info_cache with network_info: [{"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:57:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fd8f2809-4c23-4c5b-8050-27dd8f6f55c9 req-d62d69c6-0e79-42d0-bce6-98a6a4267a1a service nova] Releasing lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:57:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-7ce9a8d0-302b-42b8-9e86-46ac067ff794 req-92f66c05-925d-4d67-86b0-d39695105cf6 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7ce9a8d0-302b-42b8-9e86-46ac067ff794 req-92f66c05-925d-4d67-86b0-d39695105cf6 service nova] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7ce9a8d0-302b-42b8-9e86-46ac067ff794 req-92f66c05-925d-4d67-86b0-d39695105cf6 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7ce9a8d0-302b-42b8-9e86-46ac067ff794 req-92f66c05-925d-4d67-86b0-d39695105cf6 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-7ce9a8d0-302b-42b8-9e86-46ac067ff794 req-92f66c05-925d-4d67-86b0-d39695105cf6 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] No waiting events found dispatching network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:57:32 user nova-compute[75260]: WARNING nova.compute.manager [req-7ce9a8d0-302b-42b8-9e86-46ac067ff794 req-92f66c05-925d-4d67-86b0-d39695105cf6 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received unexpected event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd for instance with vm_state building and task_state spawning.
Nov 27 04:57:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:34 user nova-compute[75260]: INFO nova.compute.manager [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Detaching volume 68bbc192-e10f-4ccb-b7a8-266f3ff39172
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:57:34 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Instance spawned successfully.
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:57:34 user nova-compute[75260]: INFO nova.virt.block_device [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Attempting to driver detach volume 68bbc192-e10f-4ccb-b7a8-266f3ff39172 from mountpoint /dev/vdb
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.compute.manager [req-ace12bfa-3188-47f9-970e-a6780aa22e12 req-b9e138e2-0da0-4999-8d60-cdea8f683f7e service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ace12bfa-3188-47f9-970e-a6780aa22e12 req-b9e138e2-0da0-4999-8d60-cdea8f683f7e service nova] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ace12bfa-3188-47f9-970e-a6780aa22e12 req-b9e138e2-0da0-4999-8d60-cdea8f683f7e service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ace12bfa-3188-47f9-970e-a6780aa22e12 req-b9e138e2-0da0-4999-8d60-cdea8f683f7e service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.compute.manager [req-ace12bfa-3188-47f9-970e-a6780aa22e12 req-b9e138e2-0da0-4999-8d60-cdea8f683f7e service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] No waiting events found dispatching network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:57:34 user nova-compute[75260]: WARNING nova.compute.manager [req-ace12bfa-3188-47f9-970e-a6780aa22e12 req-b9e138e2-0da0-4999-8d60-cdea8f683f7e service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received unexpected event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd for instance with vm_state building and task_state spawning.
Nov 27 04:57:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Attempting to detach device vdb from instance ed53fa6e-6fef-4293-b51c-989e7b343e94 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:57:34 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:57:34 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:57:34 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:57:34 user nova-compute[75260]:   <serial>68bbc192-e10f-4ccb-b7a8-266f3ff39172</serial>
Nov 27 04:57:34 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:57:34 user nova-compute[75260]: </disk>
Nov 27 04:57:34 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:57:34 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Successfully detached device vdb from instance ed53fa6e-6fef-4293-b51c-989e7b343e94 from the persistent domain config.
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed53fa6e-6fef-4293-b51c-989e7b343e94 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:57:34 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:57:34 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 04:57:34 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:57:34 user nova-compute[75260]:   <serial>68bbc192-e10f-4ccb-b7a8-266f3ff39172</serial>
Nov 27 04:57:34 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:57:34 user nova-compute[75260]: </disk>
Nov 27 04:57:34 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:57:34 user nova-compute[75260]: INFO nova.compute.manager [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 27 04:57:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:57:35 user nova-compute[75260]: INFO nova.compute.manager [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Took 6.69 seconds to build instance.
Nov 27 04:57:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9e313fb3-c2ac-470b-ab4e-696b1f6a0cf1 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.793s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed53fa6e-6fef-4293-b51c-989e7b343e94 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:57:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:57:50 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:57:50 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:57:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:50 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:57:50 user nova-compute[75260]: INFO nova.compute.claims [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Claim successful on node user
Nov 27 04:57:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:57:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:57:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG nova.policy [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71baa1a857c5458ea2d03515ea2ccaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a344ddbabc8e48e9987d8aa73042821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:57:51 user nova-compute[75260]: INFO nova.virt.block_device [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Booting with volume 7df351ca-661d-479f-b9b0-d7fa7dc6e3fe at /dev/vda
Nov 27 04:57:51 user nova-compute[75260]: DEBUG os_brick.utils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[010f23e7-17f3-4769-8948-64138c8818ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e087233-66db-4200-bcc3-523b3c21e1e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31cb25f-ac48-408d-9e2a-eb794fe45d14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f32c1c3-df39-4365-9945-134eb4a90ff9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:57:51 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f557135-6cd2-49be-bd39-8ab8f070736d]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG os_brick.utils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== get_connector_properties: return (268ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating existing volume attachment record: 3498c3b8-305f-47e7-9b10-74e9c4fc32a6 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:57:51 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:57:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Successfully created port: 98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:57:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:57:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:57:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 04:57:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Successfully updated port: 98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:57:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:57:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquired lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:57:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d366dcc-de52-4bb3-b658-196af1505195 req-9a25b610-783c-4957-8b07-8b08430737d7 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-changed-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d366dcc-de52-4bb3-b658-196af1505195 req-9a25b610-783c-4957-8b07-8b08430737d7 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Refreshing instance network info cache due to event network-changed-98655667-82da-4c3f-8724-e58493868afe. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d366dcc-de52-4bb3-b658-196af1505195 req-9a25b610-783c-4957-8b07-8b08430737d7 service nova] Acquiring lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating instance_info_cache with network_info: [{"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Releasing lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Instance network_info: |[{"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d366dcc-de52-4bb3-b658-196af1505195 req-9a25b610-783c-4957-8b07-8b08430737d7 service nova] Acquired lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-5d366dcc-de52-4bb3-b658-196af1505195 req-9a25b610-783c-4957-8b07-8b08430737d7 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Refreshing network info cache for port 98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-5d366dcc-de52-4bb3-b658-196af1505195 req-9a25b610-783c-4957-8b07-8b08430737d7 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updated VIF entry in instance network info cache for port 98655667-82da-4c3f-8724-e58493868afe. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-5d366dcc-de52-4bb3-b658-196af1505195 req-9a25b610-783c-4957-8b07-8b08430737d7 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating instance_info_cache with network_info: [{"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d366dcc-de52-4bb3-b658-196af1505195 req-9a25b610-783c-4957-8b07-8b08430737d7 service nova] Releasing lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:57:53 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:57:54 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:57:55 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ed53fa6e-6fef-4293-b51c-989e7b343e94 is timed out.
Nov 27 04:57:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Successfully detached device vdb from instance ed53fa6e-6fef-4293-b51c-989e7b343e94 from the live domain config.
Nov 27 04:57:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRWzbTIe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:57:55 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8606fd4c-a99b-4588-9ef5-3f6486564a27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:57:55 user nova-compute[75260]: No targets found.
Nov 27 04:57:55 user nova-compute[75260]: iSNS:
Nov 27 04:57:55 user nova-compute[75260]: No targets found.
Nov 27 04:57:55 user nova-compute[75260]: STATIC:
Nov 27 04:57:55 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172
Nov 27 04:57:55 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:57:55 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:57:55 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:57:55 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:57:55 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:57:55 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb
Nov 27 04:57:55 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:57:55 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:57:55 user nova-compute[75260]: FIRMWARE:
Nov 27 04:57:55 user nova-compute[75260]: No targets found.
Nov 27 04:57:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:57:55 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:57:55 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[673b6c22-29d1-4635-8d7e-45754094f2e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c4284c-f794-4862-bc8c-bca78833a431]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:55 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:55 user nova-compute[75260]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 (non-flash)
Nov 27 04:57:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:55 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:55 user nova-compute[75260]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 (non-flash)
Nov 27 04:57:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb5410bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74fcf00-47f6-467a-a619-f349dd986877]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8588268b-ac14-4176-bcfe-224f0f63f2b9]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[799c0b39-dec4-4328-9ca1-d58a005af648]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9933ce9f-25b5-46c6-9528-06b4a68439a1]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[611df833-9c47-4748-be9c-9567d9b048c6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc9768-a2f1-42a5-af8f-49c977d3f37c]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172, portal: 172.16.0.220,3260]
Nov 27 04:57:55 user nova-compute[75260]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172, portal: 172.16.0.220,3260] successful.
Nov 27 04:57:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdab619-6334-4f1e-9d6f-449c0e6d7d08]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] <== disconnect_volume: return (326ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:57:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG nova.objects.instance [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lazy-loading 'flavor' on Instance uuid ed53fa6e-6fef-4293-b51c-989e7b343e94 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7b8dfc4b-0a6e-4a7a-b5d8-0b9f589518ce tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.920s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.711s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:56 user nova-compute[75260]: INFO nova.compute.manager [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Terminating instance
Nov 27 04:57:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-369ed482-473f-457d-87ae-139645383793 req-df996dd6-23e9-4f69-9396-a1c28eed9e42 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received event network-vif-unplugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369ed482-473f-457d-87ae-139645383793 req-df996dd6-23e9-4f69-9396-a1c28eed9e42 service nova] Acquiring lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369ed482-473f-457d-87ae-139645383793 req-df996dd6-23e9-4f69-9396-a1c28eed9e42 service nova] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-369ed482-473f-457d-87ae-139645383793 req-df996dd6-23e9-4f69-9396-a1c28eed9e42 service nova] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-369ed482-473f-457d-87ae-139645383793 req-df996dd6-23e9-4f69-9396-a1c28eed9e42 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] No waiting events found dispatching network-vif-unplugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:57:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-369ed482-473f-457d-87ae-139645383793 req-df996dd6-23e9-4f69-9396-a1c28eed9e42 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received event network-vif-unplugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Instance destroyed successfully.
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lazy-loading 'resources' on Instance uuid ed53fa6e-6fef-4293-b51c-989e7b343e94 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:57:57 user nova-compute[75260]: INFO nova.compute.manager [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Detaching volume 810f41f8-8fdc-4121-8b82-6591f565b2fb
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-30020084',display_name='tempest-VolumesSnapshotTestJSON-instance-30020084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-30020084',id=35,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb0mFNLrrV67IA+4i1d+1U9+dCQMrCqD4hSeVI35qlUKRgzjNHDKg1QrD/BgW+r2NQprOrP6C1iNqUSmHVu5xeYQrYfomiiYUPRSh7dToeBaU9cHxcZsPq1/StjEFCc7Q==',key_name='tempest-keypair-1679195181',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:55:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bff13437be5d4e46ab6ebe91272f08e4',ramdisk_id='',reservation_id='r-9gmxll1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1878477578',owner_user_name='tempest-VolumesSnapshotTestJSON-1878477578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:55:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21ac605bebd04b48ac35eb2ad41e4e00',uuid=ed53fa6e-6fef-4293-b51c-989e7b343e94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converting VIF {"id": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "address": "fa:16:3e:50:c9:a7", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b85997-64", "ovs_interfaceid": "c8b85997-6458-4494-8d0c-a9b3e3cc3b15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=c8b85997-6458-4494-8d0c-a9b3e3cc3b15,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b85997-64') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_vif [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=c8b85997-6458-4494-8d0c-a9b3e3cc3b15,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b85997-64') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8b85997-64, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ab7a5ef-ca4a-4fc0-8bde-8d35061a41ed) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:57 user nova-compute[75260]: INFO os_vif [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=c8b85997-6458-4494-8d0c-a9b3e3cc3b15,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b85997-64')
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRWzbTIe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:57:57 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f978952c-f543-4f4e-89fa-04b17fb90b61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:57:57 user nova-compute[75260]: No targets found.
Nov 27 04:57:57 user nova-compute[75260]: iSNS:
Nov 27 04:57:57 user nova-compute[75260]: No targets found.
Nov 27 04:57:57 user nova-compute[75260]: STATIC:
Nov 27 04:57:57 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:57:57 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:57:57 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:57:57 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb
Nov 27 04:57:57 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:57:57 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:57:57 user nova-compute[75260]: FIRMWARE:
Nov 27 04:57:57 user nova-compute[75260]: No targets found.
Nov 27 04:57:57 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:57:57 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:57:57 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68bbc192-e10f-4ccb-b7a8-266f3ff39172', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:57:57 user nova-compute[75260]: INFO nova.virt.block_device [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Attempting to driver detach volume 810f41f8-8fdc-4121-8b82-6591f565b2fb from mountpoint /dev/vdb
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Attempting to detach device vdb from instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:57:57 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:57:57 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:57:57 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:57:57 user nova-compute[75260]:   <serial>810f41f8-8fdc-4121-8b82-6591f565b2fb</serial>
Nov 27 04:57:57 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:57:57 user nova-compute[75260]: </disk>
Nov 27 04:57:57 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c310915-a4a4-4e15-8309-4e1e76c526ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Successfully detached device vdb from instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 from the persistent domain config.
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:57:57 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:57:57 user nova-compute[75260]:   <source dev="/dev/sdb"/>
Nov 27 04:57:57 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:57:57 user nova-compute[75260]:   <serial>810f41f8-8fdc-4121-8b82-6591f565b2fb</serial>
Nov 27 04:57:57 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:57:57 user nova-compute[75260]: </disk>
Nov 27 04:57:57 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[30508372-c983-4286-be2b-e6ef9ad4c103]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:57 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:57 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:57 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:57 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb7422d000>, {}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Disconnecting from: [] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] <== disconnect_volume: return (81ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:57:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Deleting instance files /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94_del
Nov 27 04:57:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Deletion of /opt/stack/data/nova/instances/ed53fa6e-6fef-4293-b51c-989e7b343e94_del complete
Nov 27 04:57:57 user nova-compute[75260]: INFO nova.compute.manager [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:57:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Took 0.71 seconds to deallocate network for instance.
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-3a648aea-2797-4f65-a705-03c9e5dbdec0 req-da08b6f3-bae1-4db5-acfd-68f78e6df4e4 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received event network-vif-deleted-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:58 user nova-compute[75260]: INFO nova.compute.manager [req-3a648aea-2797-4f65-a705-03c9e5dbdec0 req-da08b6f3-bae1-4db5-acfd-68f78e6df4e4 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Neutron deleted interface c8b85997-6458-4494-8d0c-a9b3e3cc3b15; detaching it from the instance and deleting it from the info cache
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-3a648aea-2797-4f65-a705-03c9e5dbdec0 req-da08b6f3-bae1-4db5-acfd-68f78e6df4e4 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-3a648aea-2797-4f65-a705-03c9e5dbdec0 req-da08b6f3-bae1-4db5-acfd-68f78e6df4e4 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Detach interface failed, port_id=c8b85997-6458-4494-8d0c-a9b3e3cc3b15, reason: Instance ed53fa6e-6fef-4293-b51c-989e7b343e94 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:57:58 user nova-compute[75260]: WARNING nova.volume.cinder [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Attachment cd7a06dd-18ce-496d-9dbd-162fa52dab8f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cd7a06dd-18ce-496d-9dbd-162fa52dab8f. (HTTP 404) (Request-ID: req-582bb90e-6bb5-4255-a861-80c094b6cc0f)
Nov 27 04:57:58 user nova-compute[75260]: INFO nova.compute.manager [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Took 0.03 seconds to detach 1 volumes for instance.
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:57:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Creating image(s)
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Ensure instance console log exists: /opt/stack/data/nova/instances/37cf41f0-c27b-4e5c-bc20-1b7d79daac1d/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Start _get_guest_xml network_info=[{"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '3498c3b8-305f-47e7-9b10-74e9c4fc32a6', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlxOncWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37cf41f0-c27b-4e5c-bc20-1b7d79daac1d', 'attached_at': '', 'detached_at': '', 'volume_id': '7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 'serial': '7df351ca-661d-479f-b9b0-d7fa7dc6e3fe'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:57:58 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:57:58 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlxOncWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:57:58 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:57:58 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:57:58 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1ccd89-beb8-4184-969a-0fdf61b1091d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:57:58 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[521111b5-2209-41f1-b804-b2e4e16a0ef9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe] added
Nov 27 04:57:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c3a660-3a44-477c-9960-d15fa90e447c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a68711-99b8-4894-bbc0-5b8afef9c492]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlxOncWD {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlxOncWD" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54db94e-6501-49f0-a4ce-7b822194e9cd]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XlxOncWD'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3139915e-09a8-4e1c-b51b-1cb8da3c57c1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e749a5-d0fb-47e2-82c1-45375259db3e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:58 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:58 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2848a931-dd83-4f35-a5c1-33a061a9bc53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260]
Nov 27 04:57:58 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260] successful.
Nov 27 04:57:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8269ad-4fdb-43fd-9f5d-12a3e71c2a7e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc395c2e-cdb3-4afa-ae3f-65c9853c0935]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:58 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:58 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:57:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:57:58 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:57:58 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:57:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:57:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:57:59 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Deleted allocations for instance ed53fa6e-6fef-4293-b51c-989e7b343e94
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b2e717-46a4-4776-8eba-918b184818fb]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-3d3a5887-3f09-4077-b09b-0ee9052855f9 req-249c6051-44a8-4a8a-9daf-197144b3bf21 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received event network-vif-plugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3d3a5887-3f09-4077-b09b-0ee9052855f9 req-249c6051-44a8-4a8a-9daf-197144b3bf21 service nova] Acquiring lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3d3a5887-3f09-4077-b09b-0ee9052855f9 req-249c6051-44a8-4a8a-9daf-197144b3bf21 service nova] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3d3a5887-3f09-4077-b09b-0ee9052855f9 req-249c6051-44a8-4a8a-9daf-197144b3bf21 service nova] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-3d3a5887-3f09-4077-b09b-0ee9052855f9 req-249c6051-44a8-4a8a-9daf-197144b3bf21 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] No waiting events found dispatching network-vif-plugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:57:59 user nova-compute[75260]: WARNING nova.compute.manager [req-3d3a5887-3f09-4077-b09b-0ee9052855f9 req-249c6051-44a8-4a8a-9daf-197144b3bf21 service nova] [instance: ed53fa6e-6fef-4293-b51c-989e7b343e94] Received unexpected event network-vif-plugged-c8b85997-6458-4494-8d0c-a9b3e3cc3b15 for instance with vm_state deleted and task_state None.
Nov 27 04:57:59 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlxOncWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2e2fbc2e-a7c9-47db-a113-80f2cf03474d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "ed53fa6e-6fef-4293-b51c-989e7b343e94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.503s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:57:59 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '23438373864323337', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438373864323337', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2106560057',display_name='tempest-ServerActionsTestOtherA-server-2106560057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2106560057',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOij+0g1QbUNojcJl3yIM3Tv96IeOdvkNKm5ThbXwXoQhcjwE76rap7fFhOUAjRiN20jCHkXP7XPhGl+HzdyShkrkNHzkMrulgl7gxlMCqAAOAl9YSxm9bSuYOmPOCmkIw==',key_name='tempest-keypair-1643056830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-tj0rxw1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=37cf41f0-c27b-4e5c-bc20-1b7d79daac1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.objects.instance [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'pci_devices' on Instance uuid 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:58:00 user nova-compute[75260]:   <uuid>37cf41f0-c27b-4e5c-bc20-1b7d79daac1d</uuid>
Nov 27 04:58:00 user nova-compute[75260]:   <name>instance-00000027</name>
Nov 27 04:58:00 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:58:00 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:58:00 user nova-compute[75260]:   <metadata>
Nov 27 04:58:00 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:58:00 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:58:00 user nova-compute[75260]:       <nova:name>tempest-ServerActionsTestOtherA-server-2106560057</nova:name>
Nov 27 04:58:00 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:57:58</nova:creationTime>
Nov 27 04:58:00 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:58:00 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:58:00 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:58:00 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:58:00 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:58:00 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:58:00 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:58:00 user nova-compute[75260]:       <nova:owner>
Nov 27 04:58:00 user nova-compute[75260]:         <nova:user uuid="71baa1a857c5458ea2d03515ea2ccaf3">tempest-ServerActionsTestOtherA-678795315-project-member</nova:user>
Nov 27 04:58:00 user nova-compute[75260]:         <nova:project uuid="a344ddbabc8e48e9987d8aa73042821a">tempest-ServerActionsTestOtherA-678795315</nova:project>
Nov 27 04:58:00 user nova-compute[75260]:       </nova:owner>
Nov 27 04:58:00 user nova-compute[75260]:       <nova:ports>
Nov 27 04:58:00 user nova-compute[75260]:         <nova:port uuid="98655667-82da-4c3f-8724-e58493868afe">
Nov 27 04:58:00 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 04:58:00 user nova-compute[75260]:         </nova:port>
Nov 27 04:58:00 user nova-compute[75260]:       </nova:ports>
Nov 27 04:58:00 user nova-compute[75260]:     </nova:instance>
Nov 27 04:58:00 user nova-compute[75260]:   </metadata>
Nov 27 04:58:00 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:58:00 user nova-compute[75260]:     <system>
Nov 27 04:58:00 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:58:00 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:58:00 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:58:00 user nova-compute[75260]:       <entry name="serial">37cf41f0-c27b-4e5c-bc20-1b7d79daac1d</entry>
Nov 27 04:58:00 user nova-compute[75260]:       <entry name="uuid">37cf41f0-c27b-4e5c-bc20-1b7d79daac1d</entry>
Nov 27 04:58:00 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:58:00 user nova-compute[75260]:     </system>
Nov 27 04:58:00 user nova-compute[75260]:   </sysinfo>
Nov 27 04:58:00 user nova-compute[75260]:   <os>
Nov 27 04:58:00 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:58:00 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:58:00 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:58:00 user nova-compute[75260]:   </os>
Nov 27 04:58:00 user nova-compute[75260]:   <features>
Nov 27 04:58:00 user nova-compute[75260]:     <acpi/>
Nov 27 04:58:00 user nova-compute[75260]:     <apic/>
Nov 27 04:58:00 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:58:00 user nova-compute[75260]:   </features>
Nov 27 04:58:00 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:58:00 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:58:00 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:58:00 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:58:00 user nova-compute[75260]:   </clock>
Nov 27 04:58:00 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:58:00 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:58:00 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:58:00 user nova-compute[75260]:   </cpu>
Nov 27 04:58:00 user nova-compute[75260]:   <devices>
Nov 27 04:58:00 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:58:00 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:58:00 user nova-compute[75260]:       <source dev="/dev/sdc"/>
Nov 27 04:58:00 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:58:00 user nova-compute[75260]:       <serial>7df351ca-661d-479f-b9b0-d7fa7dc6e3fe</serial>
Nov 27 04:58:00 user nova-compute[75260]:     </disk>
Nov 27 04:58:00 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:58:00 user nova-compute[75260]:       <mac address="fa:16:3e:41:ff:72"/>
Nov 27 04:58:00 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:58:00 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:58:00 user nova-compute[75260]:       <target dev="tap98655667-82"/>
Nov 27 04:58:00 user nova-compute[75260]:     </interface>
Nov 27 04:58:00 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:58:00 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/37cf41f0-c27b-4e5c-bc20-1b7d79daac1d/console.log" append="off"/>
Nov 27 04:58:00 user nova-compute[75260]:     </serial>
Nov 27 04:58:00 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:58:00 user nova-compute[75260]:     <video>
Nov 27 04:58:00 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:58:00 user nova-compute[75260]:     </video>
Nov 27 04:58:00 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:58:00 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:58:00 user nova-compute[75260]:     </rng>
Nov 27 04:58:00 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:58:00 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:58:00 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:58:00 user nova-compute[75260]:     </memballoon>
Nov 27 04:58:00 user nova-compute[75260]:   </devices>
Nov 27 04:58:00 user nova-compute[75260]: </domain>
Nov 27 04:58:00 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2106560057',display_name='tempest-ServerActionsTestOtherA-server-2106560057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2106560057',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOij+0g1QbUNojcJl3yIM3Tv96IeOdvkNKm5ThbXwXoQhcjwE76rap7fFhOUAjRiN20jCHkXP7XPhGl+HzdyShkrkNHzkMrulgl7gxlMCqAAOAl9YSxm9bSuYOmPOCmkIw==',key_name='tempest-keypair-1643056830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-tj0rxw1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=37cf41f0-c27b-4e5c-bc20-1b7d79daac1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG os_vif [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52eae947-6541-5934-9f2e-a0b8733d0cfd', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98655667-82, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98655667-82, col_values=(('qos', UUID('e574e33d-dbdc-4d1c-a529-5d9a4112536c')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98655667-82, col_values=(('external_ids', {'iface-id': '98655667-82da-4c3f-8724-e58493868afe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:ff:72', 'vm-uuid': '37cf41f0-c27b-4e5c-bc20-1b7d79daac1d'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:00 user nova-compute[75260]: INFO os_vif [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82')
Nov 27 04:58:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No VIF found with MAC fa:16:3e:41:ff:72, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:00 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:58:00 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:58:00 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7966MB free_disk=25.211082458496094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1a25081f-79d1-412f-bf99-4235516d40a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4bff94d1-4400-4dff-baff-fc10c8070b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.manager [req-6b4463b1-3105-438b-b482-cec872cb67cd req-614e200c-e582-4bec-9445-9b29250c0bfc service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6b4463b1-3105-438b-b482-cec872cb67cd req-614e200c-e582-4bec-9445-9b29250c0bfc service nova] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6b4463b1-3105-438b-b482-cec872cb67cd req-614e200c-e582-4bec-9445-9b29250c0bfc service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6b4463b1-3105-438b-b482-cec872cb67cd req-614e200c-e582-4bec-9445-9b29250c0bfc service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:01 user nova-compute[75260]: DEBUG nova.compute.manager [req-6b4463b1-3105-438b-b482-cec872cb67cd req-614e200c-e582-4bec-9445-9b29250c0bfc service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] No waiting events found dispatching network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:01 user nova-compute[75260]: WARNING nova.compute.manager [req-6b4463b1-3105-438b-b482-cec872cb67cd req-614e200c-e582-4bec-9445-9b29250c0bfc service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received unexpected event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe for instance with vm_state building and task_state spawning.
Nov 27 04:58:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:58:03 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Instance spawned successfully.
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:03 user nova-compute[75260]: INFO nova.compute.manager [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:58:03 user nova-compute[75260]: INFO nova.compute.manager [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Took 12.93 seconds to build instance.
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-faef0334-4750-4d4e-bcbe-016a2aedcea5 req-99fb8b5a-a419-40f0-aaa4-6b5d8438ca2c service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-faef0334-4750-4d4e-bcbe-016a2aedcea5 req-99fb8b5a-a419-40f0-aaa4-6b5d8438ca2c service nova] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-faef0334-4750-4d4e-bcbe-016a2aedcea5 req-99fb8b5a-a419-40f0-aaa4-6b5d8438ca2c service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-faef0334-4750-4d4e-bcbe-016a2aedcea5 req-99fb8b5a-a419-40f0-aaa4-6b5d8438ca2c service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-faef0334-4750-4d4e-bcbe-016a2aedcea5 req-99fb8b5a-a419-40f0-aaa4-6b5d8438ca2c service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] No waiting events found dispatching network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:03 user nova-compute[75260]: WARNING nova.compute.manager [req-faef0334-4750-4d4e-bcbe-016a2aedcea5 req-99fb8b5a-a419-40f0-aaa4-6b5d8438ca2c service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received unexpected event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe for instance with vm_state active and task_state None.
Nov 27 04:58:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-9c0e95ca-3468-4cfb-b1dc-12b1648b5ff7 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.027s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:58:15 user nova-compute[75260]: INFO nova.compute.claims [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Claim successful on node user
Nov 27 04:58:15 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:58:15 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:58:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG nova.policy [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e48682a815e4ec38876b91a70718ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd9716601a4207b876ddcffff6458c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:58:15 user nova-compute[75260]: INFO nova.virt.block_device [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Booting with volume 4e67cdb0-e77b-4a92-b2fc-a44eca67d54e at /dev/vda
Nov 27 04:58:15 user nova-compute[75260]: DEBUG os_brick.utils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc34367-6438-4309-a7d5-36f160ce9e23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5fc9e-18d8-4c8f-a5f6-26fe8eb45455]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1947e97c-036f-464c-84ca-5c5e70e1b393]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5abc08-e9d1-471f-9f0b-729b8ccf5db2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:58:16 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:58:16 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa4f4d9-df11-40c4-8d1e-8fb0c6ef6106]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG os_brick.utils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating existing volume attachment record: f45c0e0a-b57a-4399-8c78-38b930aeeb3a {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:58:16 user nova-compute[75260]: DEBUG nova.network.neutron [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Successfully created port: 98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.network.neutron [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Successfully updated port: 98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquired lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.network.neutron [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-6f6e3e7d-f359-4c72-b8d6-80f8c82cd0b5 req-bdeb624e-fe47-46aa-ada1-8bafdbc9b785 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-changed-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-6f6e3e7d-f359-4c72-b8d6-80f8c82cd0b5 req-bdeb624e-fe47-46aa-ada1-8bafdbc9b785 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Refreshing instance network info cache due to event network-changed-98eae3b9-3a88-4152-a0f4-feef155827e0. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6f6e3e7d-f359-4c72-b8d6-80f8c82cd0b5 req-bdeb624e-fe47-46aa-ada1-8bafdbc9b785 service nova] Acquiring lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.network.neutron [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.network.neutron [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating instance_info_cache with network_info: [{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Releasing lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.compute.manager [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Instance network_info: |[{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6f6e3e7d-f359-4c72-b8d6-80f8c82cd0b5 req-bdeb624e-fe47-46aa-ada1-8bafdbc9b785 service nova] Acquired lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.network.neutron [req-6f6e3e7d-f359-4c72-b8d6-80f8c82cd0b5 req-bdeb624e-fe47-46aa-ada1-8bafdbc9b785 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Refreshing network info cache for port 98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.network.neutron [req-6f6e3e7d-f359-4c72-b8d6-80f8c82cd0b5 req-bdeb624e-fe47-46aa-ada1-8bafdbc9b785 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updated VIF entry in instance network info cache for port 98eae3b9-3a88-4152-a0f4-feef155827e0. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.network.neutron [req-6f6e3e7d-f359-4c72-b8d6-80f8c82cd0b5 req-bdeb624e-fe47-46aa-ada1-8bafdbc9b785 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating instance_info_cache with network_info: [{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6f6e3e7d-f359-4c72-b8d6-80f8c82cd0b5 req-bdeb624e-fe47-46aa-ada1-8bafdbc9b785 service nova] Releasing lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:58:17 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 is timed out.
Nov 27 04:58:17 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Successfully detached device vdb from instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0 from the live domain config.
Nov 27 04:58:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYFtUPpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:58:17 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:58:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea41c71-70a7-454a-b759-faf771e7fb25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:58:17 user nova-compute[75260]: No targets found.
Nov 27 04:58:17 user nova-compute[75260]: iSNS:
Nov 27 04:58:17 user nova-compute[75260]: No targets found.
Nov 27 04:58:17 user nova-compute[75260]: STATIC:
Nov 27 04:58:17 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:58:17 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:58:17 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:58:17 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 04:58:17 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:58:17 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:58:17 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb
Nov 27 04:58:17 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:58:17 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:58:17 user nova-compute[75260]: FIRMWARE:
Nov 27 04:58:17 user nova-compute[75260]: No targets found.
Nov 27 04:58:17 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:58:17 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:58:17 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa94259-3d69-4b88-b0ae-3ea664c9d6e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4eec01-f9cc-4c05-b420-fb1414025292]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:58:18 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:58:18 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:58:18 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:58:18 user nova-compute[75260]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb (non-flash)
Nov 27 04:58:18 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:58:18 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb541bbd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[31682710-9797-4643-801e-58c0e99b1b11]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b78ace-de26-49b8-bbbd-78101b80780b]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d8f795-f5e6-4b50-a284-5578378942a8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f0cb2b-3454-4933-b054-6f2e16f04faf]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b527ca2c-f762-4e7d-b595-9baa9c0afc08]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c52f96b-1f7e-493d-a080-65635215298c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb, portal: 172.16.0.220,3260]
Nov 27 04:58:18 user nova-compute[75260]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb, portal: 172.16.0.220,3260] successful.
Nov 27 04:58:18 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:810f41f8-8fdc-4121-8b82-6591f565b2fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0fa853-18b9-4327-afdf-e0ee96c093de]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] <== disconnect_volume: return (303ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:58:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:58:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:22 user nova-compute[75260]: DEBUG nova.objects.instance [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lazy-loading 'flavor' on Instance uuid 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:58:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-596c608f-48de-4eb5-a905-03ab040c56f2 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.352s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.compute.manager [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:58:23 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Creating image(s)
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Ensure instance console log exists: /opt/stack/data/nova/instances/4f619b72-fa16-4ae8-8693-00b8d2fa5910/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Start _get_guest_xml network_info=[{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'f45c0e0a-b57a-4399-8c78-38b930aeeb3a', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASLuoGVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f619b72-fa16-4ae8-8693-00b8d2fa5910', 'attached_at': '', 'detached_at': '', 'volume_id': '4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 'serial': '4e67cdb0-e77b-4a92-b2fc-a44eca67d54e'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:58:23 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:58:23 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASLuoGVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:58:23 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:58:23 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:58:23 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bcbe99-a143-4c4e-be31-39cfc5f14ec8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:58:23 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a673ad-3e53-4119-8723-f996fc035463]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e] added
Nov 27 04:58:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21f43df-4ce1-431e-b30c-ae4ad12ad4b7]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.046s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6124b00-0c01-47dc-8ec1-de01393aaa8c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASLuoGVZ {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASLuoGVZ" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b37f7df-b304-461e-ba9f-a7f1d7b430e8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASLuoGVZ'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e827ee8-c262-419b-8d95-5c7aebb5e30f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b092e1-4629-4c81-ac8d-d002ce8fa285]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:58:23 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:58:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:58:23 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:58:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dd6129-1576-4083-bd11-62fa75f29ed7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260]
Nov 27 04:58:23 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260] successful.
Nov 27 04:58:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cab0fc8-b94d-4ad4-9a11-70b85c715f73]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3178cc03-acc1-4f57-9888-6931ce51d179]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:58:23 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:58:23 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:58:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:58:23 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:58:23 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:58:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:58:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:24 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a18437f-342e-4088-93c1-a169d21da9b4]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:58:24 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:58:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASLuoGVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23431383136633538', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431383136633538', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1751229513',display_name='tempest-TestShelveInstance-server-1751229513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1751229513',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTjm39bq9T3Aj9FAOay1ZJVrSQPO1ihgbXN1DUbPUuuVmLiFKRDNNnD6W9uzjR++u8JrbTp6q95i4UZh9F8GHb11y8Dz1R3heMWfS6Cxl4yoYMnLOlSvj4cXiW8AYfO0w==',key_name='tempest-TestShelveInstance-141016732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bdd9716601a4207b876ddcffff6458c',ramdisk_id='',reservation_id='r-ilmv1pst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1324535314',owner_user_name='tempest-TestShelveInstance-1324535314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:58:16Z,user_data=None,user_id='2e48682a815e4ec38876b91a70718ed2',uuid=4f619b72-fa16-4ae8-8693-00b8d2fa5910,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converting VIF {"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.objects.instance [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f619b72-fa16-4ae8-8693-00b8d2fa5910 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:58:25 user nova-compute[75260]:   <uuid>4f619b72-fa16-4ae8-8693-00b8d2fa5910</uuid>
Nov 27 04:58:25 user nova-compute[75260]:   <name>instance-00000028</name>
Nov 27 04:58:25 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:58:25 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:58:25 user nova-compute[75260]:   <metadata>
Nov 27 04:58:25 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:58:25 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:58:25 user nova-compute[75260]:       <nova:name>tempest-TestShelveInstance-server-1751229513</nova:name>
Nov 27 04:58:25 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:58:23</nova:creationTime>
Nov 27 04:58:25 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:58:25 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:58:25 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:58:25 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:58:25 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:58:25 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:58:25 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:58:25 user nova-compute[75260]:       <nova:owner>
Nov 27 04:58:25 user nova-compute[75260]:         <nova:user uuid="2e48682a815e4ec38876b91a70718ed2">tempest-TestShelveInstance-1324535314-project-member</nova:user>
Nov 27 04:58:25 user nova-compute[75260]:         <nova:project uuid="6bdd9716601a4207b876ddcffff6458c">tempest-TestShelveInstance-1324535314</nova:project>
Nov 27 04:58:25 user nova-compute[75260]:       </nova:owner>
Nov 27 04:58:25 user nova-compute[75260]:       <nova:ports>
Nov 27 04:58:25 user nova-compute[75260]:         <nova:port uuid="98eae3b9-3a88-4152-a0f4-feef155827e0">
Nov 27 04:58:25 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 04:58:25 user nova-compute[75260]:         </nova:port>
Nov 27 04:58:25 user nova-compute[75260]:       </nova:ports>
Nov 27 04:58:25 user nova-compute[75260]:     </nova:instance>
Nov 27 04:58:25 user nova-compute[75260]:   </metadata>
Nov 27 04:58:25 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:58:25 user nova-compute[75260]:     <system>
Nov 27 04:58:25 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:58:25 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:58:25 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:58:25 user nova-compute[75260]:       <entry name="serial">4f619b72-fa16-4ae8-8693-00b8d2fa5910</entry>
Nov 27 04:58:25 user nova-compute[75260]:       <entry name="uuid">4f619b72-fa16-4ae8-8693-00b8d2fa5910</entry>
Nov 27 04:58:25 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:58:25 user nova-compute[75260]:     </system>
Nov 27 04:58:25 user nova-compute[75260]:   </sysinfo>
Nov 27 04:58:25 user nova-compute[75260]:   <os>
Nov 27 04:58:25 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:58:25 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:58:25 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:58:25 user nova-compute[75260]:   </os>
Nov 27 04:58:25 user nova-compute[75260]:   <features>
Nov 27 04:58:25 user nova-compute[75260]:     <acpi/>
Nov 27 04:58:25 user nova-compute[75260]:     <apic/>
Nov 27 04:58:25 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:58:25 user nova-compute[75260]:   </features>
Nov 27 04:58:25 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:58:25 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:58:25 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:58:25 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:58:25 user nova-compute[75260]:   </clock>
Nov 27 04:58:25 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:58:25 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:58:25 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:58:25 user nova-compute[75260]:   </cpu>
Nov 27 04:58:25 user nova-compute[75260]:   <devices>
Nov 27 04:58:25 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:58:25 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:58:25 user nova-compute[75260]:       <source dev="/dev/sdb"/>
Nov 27 04:58:25 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:58:25 user nova-compute[75260]:       <serial>4e67cdb0-e77b-4a92-b2fc-a44eca67d54e</serial>
Nov 27 04:58:25 user nova-compute[75260]:     </disk>
Nov 27 04:58:25 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:58:25 user nova-compute[75260]:       <mac address="fa:16:3e:fc:40:25"/>
Nov 27 04:58:25 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:58:25 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:58:25 user nova-compute[75260]:       <target dev="tap98eae3b9-3a"/>
Nov 27 04:58:25 user nova-compute[75260]:     </interface>
Nov 27 04:58:25 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:58:25 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/4f619b72-fa16-4ae8-8693-00b8d2fa5910/console.log" append="off"/>
Nov 27 04:58:25 user nova-compute[75260]:     </serial>
Nov 27 04:58:25 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:58:25 user nova-compute[75260]:     <video>
Nov 27 04:58:25 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:58:25 user nova-compute[75260]:     </video>
Nov 27 04:58:25 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:58:25 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:58:25 user nova-compute[75260]:     </rng>
Nov 27 04:58:25 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:58:25 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:58:25 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:58:25 user nova-compute[75260]:     </memballoon>
Nov 27 04:58:25 user nova-compute[75260]:   </devices>
Nov 27 04:58:25 user nova-compute[75260]: </domain>
Nov 27 04:58:25 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1751229513',display_name='tempest-TestShelveInstance-server-1751229513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1751229513',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTjm39bq9T3Aj9FAOay1ZJVrSQPO1ihgbXN1DUbPUuuVmLiFKRDNNnD6W9uzjR++u8JrbTp6q95i4UZh9F8GHb11y8Dz1R3heMWfS6Cxl4yoYMnLOlSvj4cXiW8AYfO0w==',key_name='tempest-TestShelveInstance-141016732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bdd9716601a4207b876ddcffff6458c',ramdisk_id='',reservation_id='r-ilmv1pst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1324535314',owner_user_name='tempest-TestShelveInstance-1324535314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:58:16Z,user_data=None,user_id='2e48682a815e4ec38876b91a70718ed2',uuid=4f619b72-fa16-4ae8-8693-00b8d2fa5910,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converting VIF {"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG os_vif [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7e48ac4-f43e-58e1-b650-d3eed6ae9b02', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98eae3b9-3a, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98eae3b9-3a, col_values=(('qos', UUID('6d79f80f-c3d0-4d20-9ea8-9c4c9bbc828f')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98eae3b9-3a, col_values=(('external_ids', {'iface-id': '98eae3b9-3a88-4152-a0f4-feef155827e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:40:25', 'vm-uuid': '4f619b72-fa16-4ae8-8693-00b8d2fa5910'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:25 user nova-compute[75260]: INFO os_vif [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a')
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:58:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] No VIF found with MAC fa:16:3e:fc:40:25, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:58:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-7b123d82-ff0a-4f2f-bacf-f239f853b85f req-b37f6c79-3916-4270-9bab-4a0f3c642dae service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7b123d82-ff0a-4f2f-bacf-f239f853b85f req-b37f6c79-3916-4270-9bab-4a0f3c642dae service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7b123d82-ff0a-4f2f-bacf-f239f853b85f req-b37f6c79-3916-4270-9bab-4a0f3c642dae service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7b123d82-ff0a-4f2f-bacf-f239f853b85f req-b37f6c79-3916-4270-9bab-4a0f3c642dae service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-7b123d82-ff0a-4f2f-bacf-f239f853b85f req-b37f6c79-3916-4270-9bab-4a0f3c642dae service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:26 user nova-compute[75260]: WARNING nova.compute.manager [req-7b123d82-ff0a-4f2f-bacf-f239f853b85f req-b37f6c79-3916-4270-9bab-4a0f3c642dae service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received unexpected event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with vm_state building and task_state spawning.
Nov 27 04:58:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.compute.manager [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:58:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Instance spawned successfully.
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-bb4ad77c-49c0-44de-a8e4-0675ac1bb81a req-b2bc4201-55a1-405f-a175-b2caa806bf0f service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bb4ad77c-49c0-44de-a8e4-0675ac1bb81a req-b2bc4201-55a1-405f-a175-b2caa806bf0f service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bb4ad77c-49c0-44de-a8e4-0675ac1bb81a req-b2bc4201-55a1-405f-a175-b2caa806bf0f service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bb4ad77c-49c0-44de-a8e4-0675ac1bb81a req-b2bc4201-55a1-405f-a175-b2caa806bf0f service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-bb4ad77c-49c0-44de-a8e4-0675ac1bb81a req-b2bc4201-55a1-405f-a175-b2caa806bf0f service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:28 user nova-compute[75260]: WARNING nova.compute.manager [req-bb4ad77c-49c0-44de-a8e4-0675ac1bb81a req-b2bc4201-55a1-405f-a175-b2caa806bf0f service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received unexpected event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with vm_state building and task_state spawning.
Nov 27 04:58:28 user nova-compute[75260]: INFO nova.compute.manager [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 27 04:58:28 user nova-compute[75260]: DEBUG nova.compute.manager [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:58:28 user nova-compute[75260]: INFO nova.compute.manager [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Took 13.62 seconds to build instance.
Nov 27 04:58:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-cf28afd2-dd6f-4426-8a11-205e19710594 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.717s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:29 user nova-compute[75260]: INFO nova.compute.manager [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Terminating instance
Nov 27 04:58:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-20ccd442-39ee-4e59-a84e-cc6a99dee93c req-b1c5c823-e990-4341-9609-54dbd4f0c3df service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-vif-unplugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-20ccd442-39ee-4e59-a84e-cc6a99dee93c req-b1c5c823-e990-4341-9609-54dbd4f0c3df service nova] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-20ccd442-39ee-4e59-a84e-cc6a99dee93c req-b1c5c823-e990-4341-9609-54dbd4f0c3df service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-20ccd442-39ee-4e59-a84e-cc6a99dee93c req-b1c5c823-e990-4341-9609-54dbd4f0c3df service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-20ccd442-39ee-4e59-a84e-cc6a99dee93c req-b1c5c823-e990-4341-9609-54dbd4f0c3df service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] No waiting events found dispatching network-vif-unplugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-20ccd442-39ee-4e59-a84e-cc6a99dee93c req-b1c5c823-e990-4341-9609-54dbd4f0c3df service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-vif-unplugged-153af088-6d7c-4240-aa51-58e14b7446bc for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Instance destroyed successfully.
Nov 27 04:58:29 user nova-compute[75260]: DEBUG nova.objects.instance [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lazy-loading 'resources' on Instance uuid 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1974874179',display_name='tempest-VolumesActionsTest-instance-1974874179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1974874179',id=36,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:56:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b0696f0dfdd40db9b5e8b9aa6397ab7',ramdisk_id='',reservation_id='r-ghn5lnzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1777164428',owner_user_name='tempest-VolumesActionsTest-1777164428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:56:42Z,user_data=None,user_id='47c5ef7ba8434a4797330f38f74439f6',uuid=0dfea8aa-6f7f-48e4-a7dd-e227707e02c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "153af088-6d7c-4240-aa51-58e14b7446bc", "address": "fa:16:3e:e6:06:e6", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153af088-6d", "ovs_interfaceid": "153af088-6d7c-4240-aa51-58e14b7446bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converting VIF {"id": "153af088-6d7c-4240-aa51-58e14b7446bc", "address": "fa:16:3e:e6:06:e6", "network": {"id": "d7371be5-62c5-4d0e-8b1d-0bb05b21edb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-767573718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0696f0dfdd40db9b5e8b9aa6397ab7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153af088-6d", "ovs_interfaceid": "153af088-6d7c-4240-aa51-58e14b7446bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:06:e6,bridge_name='br-int',has_traffic_filtering=True,id=153af088-6d7c-4240-aa51-58e14b7446bc,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153af088-6d') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG os_vif [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:06:e6,bridge_name='br-int',has_traffic_filtering=True,id=153af088-6d7c-4240-aa51-58e14b7446bc,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153af088-6d') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap153af088-6d, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5047771f-1db1-4b03-b00a-471b78d6a054) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:29 user nova-compute[75260]: INFO os_vif [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:06:e6,bridge_name='br-int',has_traffic_filtering=True,id=153af088-6d7c-4240-aa51-58e14b7446bc,network=Network(d7371be5-62c5-4d0e-8b1d-0bb05b21edb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153af088-6d')
Nov 27 04:58:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Deleting instance files /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3_del
Nov 27 04:58:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Deletion of /opt/stack/data/nova/instances/0dfea8aa-6f7f-48e4-a7dd-e227707e02c3_del complete
Nov 27 04:58:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:30 user nova-compute[75260]: INFO nova.compute.manager [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 27 04:58:30 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:58:30 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Took 0.64 seconds to deallocate network for instance.
Nov 27 04:58:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-efc64808-d460-4a85-a5a3-476a4c88bc82 req-dff954a2-74d5-459c-b8d6-c34013baeaae service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-vif-deleted-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:30 user nova-compute[75260]: INFO nova.compute.manager [req-efc64808-d460-4a85-a5a3-476a4c88bc82 req-dff954a2-74d5-459c-b8d6-c34013baeaae service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Neutron deleted interface 153af088-6d7c-4240-aa51-58e14b7446bc; detaching it from the instance and deleting it from the info cache
Nov 27 04:58:30 user nova-compute[75260]: DEBUG nova.network.neutron [req-efc64808-d460-4a85-a5a3-476a4c88bc82 req-dff954a2-74d5-459c-b8d6-c34013baeaae service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-efc64808-d460-4a85-a5a3-476a4c88bc82 req-dff954a2-74d5-459c-b8d6-c34013baeaae service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Detach interface failed, port_id=153af088-6d7c-4240-aa51-58e14b7446bc, reason: Instance 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:31 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Deleted allocations for instance 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5286edfa-1233-4879-a552-ffd60ebfb1b4 tempest-VolumesActionsTest-1777164428 tempest-VolumesActionsTest-1777164428-project-member] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] No waiting events found dispatching network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:31 user nova-compute[75260]: WARNING nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received unexpected event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc for instance with vm_state deleted and task_state None.
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] No waiting events found dispatching network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:31 user nova-compute[75260]: WARNING nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received unexpected event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc for instance with vm_state deleted and task_state None.
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] No waiting events found dispatching network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:31 user nova-compute[75260]: WARNING nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received unexpected event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc for instance with vm_state deleted and task_state None.
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-vif-unplugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] No waiting events found dispatching network-vif-unplugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:31 user nova-compute[75260]: WARNING nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received unexpected event network-vif-unplugged-153af088-6d7c-4240-aa51-58e14b7446bc for instance with vm_state deleted and task_state None.
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Acquiring lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] Lock "0dfea8aa-6f7f-48e4-a7dd-e227707e02c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] No waiting events found dispatching network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:31 user nova-compute[75260]: WARNING nova.compute.manager [req-39e21683-8a7d-44ef-957b-1ec90e66d2bb req-4bf3e3b8-25cd-4b5a-9808-0c62e5dc8dca service nova] [instance: 0dfea8aa-6f7f-48e4-a7dd-e227707e02c3] Received unexpected event network-vif-plugged-153af088-6d7c-4240-aa51-58e14b7446bc for instance with vm_state deleted and task_state None.
Nov 27 04:58:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:58:42 user nova-compute[75260]: INFO nova.compute.claims [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Claim successful on node user
Nov 27 04:58:42 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 04:58:42 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 04:58:42 user nova-compute[75260]: DEBUG nova.policy [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21ac605bebd04b48ac35eb2ad41e4e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff13437be5d4e46ab6ebe91272f08e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 04:58:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 04:58:43 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Creating image(s)
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "/opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "/opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "/opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Successfully created port: be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk 1073741824" returned: 0 in 0.064s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:58:43 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Cannot resize image /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Ensure instance console log exists: /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Successfully updated port: be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "refresh_cache-c037e01b-1dad-48e3-9df9-187ebb3c3587" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquired lock "refresh_cache-c037e01b-1dad-48e3-9df9-187ebb3c3587" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-c19bdeef-dd9a-49da-896c-5028746b08c8 req-18bb5fe9-a500-416d-91e8-a14df6c68be7 service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received event network-changed-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-c19bdeef-dd9a-49da-896c-5028746b08c8 req-18bb5fe9-a500-416d-91e8-a14df6c68be7 service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Refreshing instance network info cache due to event network-changed-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c19bdeef-dd9a-49da-896c-5028746b08c8 req-18bb5fe9-a500-416d-91e8-a14df6c68be7 service nova] Acquiring lock "refresh_cache-c037e01b-1dad-48e3-9df9-187ebb3c3587" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Updating instance_info_cache with network_info: [{"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Releasing lock "refresh_cache-c037e01b-1dad-48e3-9df9-187ebb3c3587" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Instance network_info: |[{"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c19bdeef-dd9a-49da-896c-5028746b08c8 req-18bb5fe9-a500-416d-91e8-a14df6c68be7 service nova] Acquired lock "refresh_cache-c037e01b-1dad-48e3-9df9-187ebb3c3587" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-c19bdeef-dd9a-49da-896c-5028746b08c8 req-18bb5fe9-a500-416d-91e8-a14df6c68be7 service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Refreshing network info cache for port be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Start _get_guest_xml network_info=[{"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:58:44 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:58:44 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-27137687',display_name='tempest-VolumesSnapshotTestJSON-instance-27137687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-27137687',id=41,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsKKJr5Cry9CxF4XRL41Uvmw1KQNk0ACa/j/cBZDmhdRGMkMSvcOdZG/G7WYzXqtSAU4YuTo8eOH30pPHbEmN5+z25VjJ34GIyLhNpWYThHytkfParMwgQM0+JBdFdl9g==',key_name='tempest-keypair-1574529496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bff13437be5d4e46ab6ebe91272f08e4',ramdisk_id='',reservation_id='r-iimgk304',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1878477578',owner_user_name='tempest-VolumesSnapshotTestJSON-1878477578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:58:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21ac605bebd04b48ac35eb2ad41e4e00',uuid=c037e01b-1dad-48e3-9df9-187ebb3c3587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converting VIF {"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:09:64,bridge_name='br-int',has_traffic_filtering=True,id=be36c46d-0c0b-4055-a9d5-bc9e3908e7bf,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c46d-0c') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.objects.instance [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lazy-loading 'pci_devices' on Instance uuid c037e01b-1dad-48e3-9df9-187ebb3c3587 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:58:44 user nova-compute[75260]:   <uuid>c037e01b-1dad-48e3-9df9-187ebb3c3587</uuid>
Nov 27 04:58:44 user nova-compute[75260]:   <name>instance-00000029</name>
Nov 27 04:58:44 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 04:58:44 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:58:44 user nova-compute[75260]:   <metadata>
Nov 27 04:58:44 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:58:44 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:58:44 user nova-compute[75260]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-27137687</nova:name>
Nov 27 04:58:44 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:58:44</nova:creationTime>
Nov 27 04:58:44 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 04:58:44 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 04:58:44 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 04:58:44 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:58:44 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:58:44 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:58:44 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:58:44 user nova-compute[75260]:       <nova:owner>
Nov 27 04:58:44 user nova-compute[75260]:         <nova:user uuid="21ac605bebd04b48ac35eb2ad41e4e00">tempest-VolumesSnapshotTestJSON-1878477578-project-member</nova:user>
Nov 27 04:58:44 user nova-compute[75260]:         <nova:project uuid="bff13437be5d4e46ab6ebe91272f08e4">tempest-VolumesSnapshotTestJSON-1878477578</nova:project>
Nov 27 04:58:44 user nova-compute[75260]:       </nova:owner>
Nov 27 04:58:44 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 04:58:44 user nova-compute[75260]:       <nova:ports>
Nov 27 04:58:44 user nova-compute[75260]:         <nova:port uuid="be36c46d-0c0b-4055-a9d5-bc9e3908e7bf">
Nov 27 04:58:44 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 04:58:44 user nova-compute[75260]:         </nova:port>
Nov 27 04:58:44 user nova-compute[75260]:       </nova:ports>
Nov 27 04:58:44 user nova-compute[75260]:     </nova:instance>
Nov 27 04:58:44 user nova-compute[75260]:   </metadata>
Nov 27 04:58:44 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:58:44 user nova-compute[75260]:     <system>
Nov 27 04:58:44 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:58:44 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:58:44 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:58:44 user nova-compute[75260]:       <entry name="serial">c037e01b-1dad-48e3-9df9-187ebb3c3587</entry>
Nov 27 04:58:44 user nova-compute[75260]:       <entry name="uuid">c037e01b-1dad-48e3-9df9-187ebb3c3587</entry>
Nov 27 04:58:44 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:58:44 user nova-compute[75260]:     </system>
Nov 27 04:58:44 user nova-compute[75260]:   </sysinfo>
Nov 27 04:58:44 user nova-compute[75260]:   <os>
Nov 27 04:58:44 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:58:44 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:58:44 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:58:44 user nova-compute[75260]:   </os>
Nov 27 04:58:44 user nova-compute[75260]:   <features>
Nov 27 04:58:44 user nova-compute[75260]:     <acpi/>
Nov 27 04:58:44 user nova-compute[75260]:     <apic/>
Nov 27 04:58:44 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:58:44 user nova-compute[75260]:   </features>
Nov 27 04:58:44 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:58:44 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:58:44 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:58:44 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:58:44 user nova-compute[75260]:   </clock>
Nov 27 04:58:44 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:58:44 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:58:44 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:58:44 user nova-compute[75260]:   </cpu>
Nov 27 04:58:44 user nova-compute[75260]:   <devices>
Nov 27 04:58:44 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 04:58:44 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 04:58:44 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk"/>
Nov 27 04:58:44 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:58:44 user nova-compute[75260]:     </disk>
Nov 27 04:58:44 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:58:44 user nova-compute[75260]:       <mac address="fa:16:3e:ab:09:64"/>
Nov 27 04:58:44 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:58:44 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:58:44 user nova-compute[75260]:       <target dev="tapbe36c46d-0c"/>
Nov 27 04:58:44 user nova-compute[75260]:     </interface>
Nov 27 04:58:44 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:58:44 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/console.log" append="off"/>
Nov 27 04:58:44 user nova-compute[75260]:     </serial>
Nov 27 04:58:44 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:58:44 user nova-compute[75260]:     <video>
Nov 27 04:58:44 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:58:44 user nova-compute[75260]:     </video>
Nov 27 04:58:44 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:58:44 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:58:44 user nova-compute[75260]:     </rng>
Nov 27 04:58:44 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:58:44 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:58:44 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:58:44 user nova-compute[75260]:     </memballoon>
Nov 27 04:58:44 user nova-compute[75260]:   </devices>
Nov 27 04:58:44 user nova-compute[75260]: </domain>
Nov 27 04:58:44 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-27137687',display_name='tempest-VolumesSnapshotTestJSON-instance-27137687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-27137687',id=41,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsKKJr5Cry9CxF4XRL41Uvmw1KQNk0ACa/j/cBZDmhdRGMkMSvcOdZG/G7WYzXqtSAU4YuTo8eOH30pPHbEmN5+z25VjJ34GIyLhNpWYThHytkfParMwgQM0+JBdFdl9g==',key_name='tempest-keypair-1574529496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bff13437be5d4e46ab6ebe91272f08e4',ramdisk_id='',reservation_id='r-iimgk304',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1878477578',owner_user_name='tempest-VolumesSnapshotTestJSON-1878477578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:58:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21ac605bebd04b48ac35eb2ad41e4e00',uuid=c037e01b-1dad-48e3-9df9-187ebb3c3587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converting VIF {"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:09:64,bridge_name='br-int',has_traffic_filtering=True,id=be36c46d-0c0b-4055-a9d5-bc9e3908e7bf,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c46d-0c') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG os_vif [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:09:64,bridge_name='br-int',has_traffic_filtering=True,id=be36c46d-0c0b-4055-a9d5-bc9e3908e7bf,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c46d-0c') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5adb06e6-d3a2-58fb-bc6a-42326568d135', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe36c46d-0c, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe36c46d-0c, col_values=(('qos', UUID('c9fa1409-57dd-4b06-8a52-d19c8e48baec')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe36c46d-0c, col_values=(('external_ids', {'iface-id': 'be36c46d-0c0b-4055-a9d5-bc9e3908e7bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:09:64', 'vm-uuid': 'c037e01b-1dad-48e3-9df9-187ebb3c3587'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:44 user nova-compute[75260]: INFO os_vif [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:09:64,bridge_name='br-int',has_traffic_filtering=True,id=be36c46d-0c0b-4055-a9d5-bc9e3908e7bf,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c46d-0c')
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] No VIF found with MAC fa:16:3e:ab:09:64, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-c19bdeef-dd9a-49da-896c-5028746b08c8 req-18bb5fe9-a500-416d-91e8-a14df6c68be7 service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Updated VIF entry in instance network info cache for port be36c46d-0c0b-4055-a9d5-bc9e3908e7bf. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-c19bdeef-dd9a-49da-896c-5028746b08c8 req-18bb5fe9-a500-416d-91e8-a14df6c68be7 service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Updating instance_info_cache with network_info: [{"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:58:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c19bdeef-dd9a-49da-896c-5028746b08c8 req-18bb5fe9-a500-416d-91e8-a14df6c68be7 service nova] Releasing lock "refresh_cache-c037e01b-1dad-48e3-9df9-187ebb3c3587" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:58:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-4babecba-9d71-4f6a-ac42-0cee091278c8 req-d319e755-ebfa-4e13-98f9-85b13d83c63d service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received event network-vif-plugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4babecba-9d71-4f6a-ac42-0cee091278c8 req-d319e755-ebfa-4e13-98f9-85b13d83c63d service nova] Acquiring lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4babecba-9d71-4f6a-ac42-0cee091278c8 req-d319e755-ebfa-4e13-98f9-85b13d83c63d service nova] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4babecba-9d71-4f6a-ac42-0cee091278c8 req-d319e755-ebfa-4e13-98f9-85b13d83c63d service nova] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-4babecba-9d71-4f6a-ac42-0cee091278c8 req-d319e755-ebfa-4e13-98f9-85b13d83c63d service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] No waiting events found dispatching network-vif-plugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:46 user nova-compute[75260]: WARNING nova.compute.manager [req-4babecba-9d71-4f6a-ac42-0cee091278c8 req-d319e755-ebfa-4e13-98f9-85b13d83c63d service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received unexpected event network-vif-plugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf for instance with vm_state building and task_state spawning.
Nov 27 04:58:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:47 user nova-compute[75260]: INFO nova.compute.manager [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Terminating instance
Nov 27 04:58:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-f0f025ec-12de-432d-b733-3ff8469ff212 req-9b635f43-86ab-488b-af96-2fc8bfc17ae1 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-unplugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f0f025ec-12de-432d-b733-3ff8469ff212 req-9b635f43-86ab-488b-af96-2fc8bfc17ae1 service nova] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f0f025ec-12de-432d-b733-3ff8469ff212 req-9b635f43-86ab-488b-af96-2fc8bfc17ae1 service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f0f025ec-12de-432d-b733-3ff8469ff212 req-9b635f43-86ab-488b-af96-2fc8bfc17ae1 service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-f0f025ec-12de-432d-b733-3ff8469ff212 req-9b635f43-86ab-488b-af96-2fc8bfc17ae1 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] No waiting events found dispatching network-vif-unplugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-f0f025ec-12de-432d-b733-3ff8469ff212 req-9b635f43-86ab-488b-af96-2fc8bfc17ae1 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-unplugged-644a8370-b874-4106-afb9-751704c5e737 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 04:58:48 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Instance spawned successfully.
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 04:58:48 user nova-compute[75260]: INFO nova.compute.manager [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:58:48 user nova-compute[75260]: INFO nova.compute.manager [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Took 5.98 seconds to build instance.
Nov 27 04:58:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5f07549a-a977-45fa-9648-4a66a768146d tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.200s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-89e25761-17d7-465b-96b2-93a140e70ef7 req-7a8ef8a7-d2c3-4210-a63f-790bc463387c service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received event network-vif-plugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-89e25761-17d7-465b-96b2-93a140e70ef7 req-7a8ef8a7-d2c3-4210-a63f-790bc463387c service nova] Acquiring lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-89e25761-17d7-465b-96b2-93a140e70ef7 req-7a8ef8a7-d2c3-4210-a63f-790bc463387c service nova] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-89e25761-17d7-465b-96b2-93a140e70ef7 req-7a8ef8a7-d2c3-4210-a63f-790bc463387c service nova] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-89e25761-17d7-465b-96b2-93a140e70ef7 req-7a8ef8a7-d2c3-4210-a63f-790bc463387c service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] No waiting events found dispatching network-vif-plugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:48 user nova-compute[75260]: WARNING nova.compute.manager [req-89e25761-17d7-465b-96b2-93a140e70ef7 req-7a8ef8a7-d2c3-4210-a63f-790bc463387c service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received unexpected event network-vif-plugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf for instance with vm_state active and task_state None.
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:48 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Instance destroyed successfully.
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.objects.instance [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lazy-loading 'resources' on Instance uuid 49bed705-0bcf-41aa-9acc-a8117d4d47b0 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1106648627',display_name='tempest-TestServerVolumeAttachmentScenario-server-1106648627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1106648627',id=34,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4dLAUmgCK8xsk+8hhhcJisYuJXmVkh9syMfzC+cbgie9XD3WDlZ1aHKkY8izXMMF+20hzoDhzYKTlXIM0/E9M1uURyq8Ca5i9n1NhF2Ad53iYQnrbrmmh1kgmWAsxncw==',key_name='tempest-keypair-1275059708',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:55:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb59aff3328844a5b259f5a44e7bb574',ramdisk_id='',reservation_id='r-5t3ugpr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1407041504',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1407041504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea49459be634b3bb4646f78b9c2798f',uuid=49bed705-0bcf-41aa-9acc-a8117d4d47b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Converting VIF {"id": "644a8370-b874-4106-afb9-751704c5e737", "address": "fa:16:3e:f6:af:22", "network": {"id": "d2f1b28f-1bde-474a-b6d7-62bdafb1b89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2067504847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb59aff3328844a5b259f5a44e7bb574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644a8370-b8", "ovs_interfaceid": "644a8370-b874-4106-afb9-751704c5e737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:af:22,bridge_name='br-int',has_traffic_filtering=True,id=644a8370-b874-4106-afb9-751704c5e737,network=Network(d2f1b28f-1bde-474a-b6d7-62bdafb1b89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644a8370-b8') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG os_vif [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:af:22,bridge_name='br-int',has_traffic_filtering=True,id=644a8370-b874-4106-afb9-751704c5e737,network=Network(d2f1b28f-1bde-474a-b6d7-62bdafb1b89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644a8370-b8') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap644a8370-b8, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e81328bf-761d-42b8-bc2c-a2f3d617385e) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:48 user nova-compute[75260]: INFO os_vif [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:af:22,bridge_name='br-int',has_traffic_filtering=True,id=644a8370-b874-4106-afb9-751704c5e737,network=Network(d2f1b28f-1bde-474a-b6d7-62bdafb1b89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644a8370-b8')
Nov 27 04:58:48 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Deleting instance files /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0_del
Nov 27 04:58:48 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Deletion of /opt/stack/data/nova/instances/49bed705-0bcf-41aa-9acc-a8117d4d47b0_del complete
Nov 27 04:58:48 user nova-compute[75260]: INFO nova.compute.manager [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 27 04:58:48 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:58:48 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:58:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] No waiting events found dispatching network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:50 user nova-compute[75260]: WARNING nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received unexpected event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 for instance with vm_state active and task_state deleting.
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] No waiting events found dispatching network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:50 user nova-compute[75260]: WARNING nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received unexpected event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 for instance with vm_state active and task_state deleting.
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] No waiting events found dispatching network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:50 user nova-compute[75260]: WARNING nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received unexpected event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 for instance with vm_state active and task_state deleting.
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-unplugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] No waiting events found dispatching network-vif-unplugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-unplugged-644a8370-b874-4106-afb9-751704c5e737 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Acquiring lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] No waiting events found dispatching network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:58:50 user nova-compute[75260]: WARNING nova.compute.manager [req-2f774fd1-cbb1-4322-8104-43ec3d2e7c42 req-a9fc0fe1-63e0-438b-8e08-93d102ecc48a service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received unexpected event network-vif-plugged-644a8370-b874-4106-afb9-751704c5e737 for instance with vm_state active and task_state deleting.
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:58:50 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Took 1.47 seconds to deallocate network for instance.
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-16825b7f-fe67-48f5-ace8-bee4fef13f5b req-9072fda8-4860-411f-b2ee-558375344226 service nova] [instance: 49bed705-0bcf-41aa-9acc-a8117d4d47b0] Received event network-vif-deleted-644a8370-b874-4106-afb9-751704c5e737 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:50 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Deleted allocations for instance 49bed705-0bcf-41aa-9acc-a8117d4d47b0
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ed8c33b1-efdd-4127-ae7f-71ef0182cea8 tempest-TestServerVolumeAttachmentScenario-1407041504 tempest-TestServerVolumeAttachmentScenario-1407041504-project-member] Lock "49bed705-0bcf-41aa-9acc-a8117d4d47b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.051s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:50 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:51 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:51 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:58:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:58:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:58:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:58:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:58:53 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:58:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:53 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updating instance_info_cache with network_info: [{"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:58:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:58:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:58:54 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:58:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:58:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:58:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:58:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:58:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:58:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:59:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:02 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:59:02 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7732MB free_disk=25.260791778564453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1a25081f-79d1-412f-bf99-4235516d40a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4bff94d1-4400-4dff-baff-fc10c8070b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4f619b72-fa16-4ae8-8693-00b8d2fa5910 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance c037e01b-1dad-48e3-9df9-187ebb3c3587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:59:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:59:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 04:59:05 user nova-compute[75260]: INFO nova.compute.manager [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] instance snapshotting
Nov 27 04:59:05 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Beginning live snapshot process
Nov 27 04:59:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json -f qcow2 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json -f qcow2 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5v_zcipi/6c5dee5eb0514b949b309cd094a75e7e.delta 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5v_zcipi/6c5dee5eb0514b949b309cd094a75e7e.delta 1073741824" returned: 0 in 0.048s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:06 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 04:59:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:59:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75260) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 04:59:07 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 04:59:07 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 04:59:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5v_zcipi/6c5dee5eb0514b949b309cd094a75e7e.delta /opt/stack/data/nova/instances/snapshots/tmp5v_zcipi/6c5dee5eb0514b949b309cd094a75e7e {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5v_zcipi/6c5dee5eb0514b949b309cd094a75e7e.delta /opt/stack/data/nova/instances/snapshots/tmp5v_zcipi/6c5dee5eb0514b949b309cd094a75e7e" returned: 0 in 0.455s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Snapshot extracted, beginning image upload
Nov 27 04:59:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:11 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Snapshot image upload complete
Nov 27 04:59:11 user nova-compute[75260]: INFO nova.compute.manager [None req-b95a73fa-78c2-453c-8816-a407d0e3ef7a tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Took 5.14 seconds to snapshot the instance on the hypervisor.
Nov 27 04:59:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-8696b51d-1d5f-4206-83c7-ecac1f6a68bf req-6a86b705-a87d-4526-b7d1-723b5cf6fa69 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-changed-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:59:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-8696b51d-1d5f-4206-83c7-ecac1f6a68bf req-6a86b705-a87d-4526-b7d1-723b5cf6fa69 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Refreshing instance network info cache due to event network-changed-1cac0fe3-e9cf-4557-a30d-8182575753cd. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:59:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8696b51d-1d5f-4206-83c7-ecac1f6a68bf req-6a86b705-a87d-4526-b7d1-723b5cf6fa69 service nova] Acquiring lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:59:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8696b51d-1d5f-4206-83c7-ecac1f6a68bf req-6a86b705-a87d-4526-b7d1-723b5cf6fa69 service nova] Acquired lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:59:19 user nova-compute[75260]: DEBUG nova.network.neutron [req-8696b51d-1d5f-4206-83c7-ecac1f6a68bf req-6a86b705-a87d-4526-b7d1-723b5cf6fa69 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Refreshing network info cache for port 1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:59:19 user nova-compute[75260]: DEBUG nova.network.neutron [req-8696b51d-1d5f-4206-83c7-ecac1f6a68bf req-6a86b705-a87d-4526-b7d1-723b5cf6fa69 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updated VIF entry in instance network info cache for port 1cac0fe3-e9cf-4557-a30d-8182575753cd. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:59:19 user nova-compute[75260]: DEBUG nova.network.neutron [req-8696b51d-1d5f-4206-83c7-ecac1f6a68bf req-6a86b705-a87d-4526-b7d1-723b5cf6fa69 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updating instance_info_cache with network_info: [{"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:59:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8696b51d-1d5f-4206-83c7-ecac1f6a68bf req-6a86b705-a87d-4526-b7d1-723b5cf6fa69 service nova] Releasing lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:59:22 user nova-compute[75260]: INFO nova.compute.manager [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attaching volume c5a3a0dc-217a-4f8b-8843-52eea69054ca to /dev/vdb
Nov 27 04:59:22 user nova-compute[75260]: DEBUG os_brick.utils [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce444e7-9268-4e79-94c1-c9c5b3588851]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51cf0a8-7d7f-4f5b-a932-5a87af9bf273]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[533a333e-6999-4f68-a9be-0eb1d54bd851]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1761a7c-c745-4802-85fb-06d552a7080d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:59:23 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:59:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f7543a-0add-4858-940c-385617730de7]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG os_brick.utils [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updating existing volume attachment record: 0612b0c0-33e2-432d-b9b2-4eb479caf7f0 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:59:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aQfGKnyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:59:29 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:59:29 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:59:29 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[599eb923-760c-43a6-8b3b-a3af8b659e35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:59:29 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[838bc4e1-4601-43e8-9452-2a03e7a35837]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca] added
Nov 27 04:59:29 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd009a30-9f0c-4bcb-b632-7071ea5a3392]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4099033e-0d6a-43d9-8754-7c1c71f6aa8d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aQfGKnyx {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aQfGKnyx" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[30291700-0696-426c-9871-e5ed46f08779]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aQfGKnyx'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108af5c-4b28-40b3-9c5e-9e73d63982df]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef9f01e-5304-4fab-87de-bf9e8e6e1c17]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3566bf8-acd1-4940-91da-77524f2e1723 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3566bf8-acd1-4940-91da-77524f2e1723 (non-flash)
Nov 27 04:59:29 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3566bf8-acd1-4940-91da-77524f2e1723 (non-flash)
Nov 27 04:59:29 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad37b15-ae0c-4fd3-a1ef-f17994d10ccf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca, portal: 172.16.0.220,3260]
Nov 27 04:59:29 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca, portal: 172.16.0.220,3260] successful.
Nov 27 04:59:29 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83f77be-a226-4f8d-bd34-2152e81812ec]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[161785c7-4cec-468e-b474-0bfb5c78be39]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3566bf8-acd1-4940-91da-77524f2e1723 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3566bf8-acd1-4940-91da-77524f2e1723 (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)
Nov 27 04:59:29 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3566bf8-acd1-4940-91da-77524f2e1723 (non-flash)
Nov 27 04:59:29 user nova-compute[75260]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)
Nov 27 04:59:29 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0b2f49-010a-4b83-92c7-f0424a42e113]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:59:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aQfGKnyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:59:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:59:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23234663739386537', 'path': '/dev/sde'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:59:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234663739386537', 'path': '/dev/sde'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:59:30 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:59:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:59:30 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:59:30 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:59:30 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:59:30 user nova-compute[75260]:   <serial>c5a3a0dc-217a-4f8b-8843-52eea69054ca</serial>
Nov 27 04:59:30 user nova-compute[75260]: </disk>
Nov 27 04:59:30 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:59:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:59:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:59:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No VIF found with MAC fa:16:3e:12:c4:7b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:59:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e9efaef8-5b2e-4d71-8028-77bf0873276b tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.640s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:59:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:59:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-5fa6349c-5870-4f4c-9dc1-34db47989e81 req-437a3bb3-77c5-4f98-b15e-d7b22a9f1c50 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received event network-changed-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:59:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-5fa6349c-5870-4f4c-9dc1-34db47989e81 req-437a3bb3-77c5-4f98-b15e-d7b22a9f1c50 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Refreshing instance network info cache due to event network-changed-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:59:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5fa6349c-5870-4f4c-9dc1-34db47989e81 req-437a3bb3-77c5-4f98-b15e-d7b22a9f1c50 service nova] Acquiring lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:59:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5fa6349c-5870-4f4c-9dc1-34db47989e81 req-437a3bb3-77c5-4f98-b15e-d7b22a9f1c50 service nova] Acquired lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:59:43 user nova-compute[75260]: DEBUG nova.network.neutron [req-5fa6349c-5870-4f4c-9dc1-34db47989e81 req-437a3bb3-77c5-4f98-b15e-d7b22a9f1c50 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Refreshing network info cache for port 4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:59:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:43 user nova-compute[75260]: DEBUG nova.network.neutron [req-5fa6349c-5870-4f4c-9dc1-34db47989e81 req-437a3bb3-77c5-4f98-b15e-d7b22a9f1c50 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updated VIF entry in instance network info cache for port 4fe8daac-ecc6-4b5c-99d6-b651e3c37e82. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:59:43 user nova-compute[75260]: DEBUG nova.network.neutron [req-5fa6349c-5870-4f4c-9dc1-34db47989e81 req-437a3bb3-77c5-4f98-b15e-d7b22a9f1c50 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updating instance_info_cache with network_info: [{"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:59:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5fa6349c-5870-4f4c-9dc1-34db47989e81 req-437a3bb3-77c5-4f98-b15e-d7b22a9f1c50 service nova] Releasing lock "refresh_cache-3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:59:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-96c0d9b3-688b-417e-b45f-6418f2b14b0a req-9720b93e-d80c-4e5e-a4c3-63055cb97246 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-changed-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:59:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-96c0d9b3-688b-417e-b45f-6418f2b14b0a req-9720b93e-d80c-4e5e-a4c3-63055cb97246 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Refreshing instance network info cache due to event network-changed-98655667-82da-4c3f-8724-e58493868afe. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 04:59:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-96c0d9b3-688b-417e-b45f-6418f2b14b0a req-9720b93e-d80c-4e5e-a4c3-63055cb97246 service nova] Acquiring lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:59:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-96c0d9b3-688b-417e-b45f-6418f2b14b0a req-9720b93e-d80c-4e5e-a4c3-63055cb97246 service nova] Acquired lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:59:45 user nova-compute[75260]: DEBUG nova.network.neutron [req-96c0d9b3-688b-417e-b45f-6418f2b14b0a req-9720b93e-d80c-4e5e-a4c3-63055cb97246 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Refreshing network info cache for port 98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 04:59:46 user nova-compute[75260]: DEBUG nova.network.neutron [req-96c0d9b3-688b-417e-b45f-6418f2b14b0a req-9720b93e-d80c-4e5e-a4c3-63055cb97246 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updated VIF entry in instance network info cache for port 98655667-82da-4c3f-8724-e58493868afe. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 04:59:46 user nova-compute[75260]: DEBUG nova.network.neutron [req-96c0d9b3-688b-417e-b45f-6418f2b14b0a req-9720b93e-d80c-4e5e-a4c3-63055cb97246 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating instance_info_cache with network_info: [{"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:59:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-96c0d9b3-688b-417e-b45f-6418f2b14b0a req-9720b93e-d80c-4e5e-a4c3-63055cb97246 service nova] Releasing lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:59:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Stashing vm_state: active {{(pid=75260) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 27 04:59:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:59:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:59:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 04:59:47 user nova-compute[75260]: INFO nova.compute.claims [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Claim successful on node user
Nov 27 04:59:47 user nova-compute[75260]: INFO nova.compute.resource_tracker [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating resource usage from migration 6f2a7f9c-a756-4a0b-a4e6-62e2a6cf4c50
Nov 27 04:59:47 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:59:47 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:59:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.458s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:59:47 user nova-compute[75260]: INFO nova.compute.manager [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Migrating
Nov 27 04:59:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:59:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquired lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:59:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:59:48 user nova-compute[75260]: INFO nova.compute.manager [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Detaching volume c5a3a0dc-217a-4f8b-8843-52eea69054ca
Nov 27 04:59:48 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating instance_info_cache with network_info: [{"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Releasing lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:59:48 user nova-compute[75260]: INFO nova.virt.block_device [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attempting to driver detach volume c5a3a0dc-217a-4f8b-8843-52eea69054ca from mountpoint /dev/vdb
Nov 27 04:59:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Attempting to detach device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:59:48 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:59:48 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:59:48 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:59:48 user nova-compute[75260]:   <serial>c5a3a0dc-217a-4f8b-8843-52eea69054ca</serial>
Nov 27 04:59:48 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:59:48 user nova-compute[75260]: </disk>
Nov 27 04:59:48 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:59:48 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Successfully detached device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the persistent domain config.
Nov 27 04:59:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:59:48 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:59:48 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 04:59:48 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:59:48 user nova-compute[75260]:   <serial>c5a3a0dc-217a-4f8b-8843-52eea69054ca</serial>
Nov 27 04:59:48 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:59:48 user nova-compute[75260]: </disk>
Nov 27 04:59:48 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Starting migrate_disk_and_power_off {{(pid=75260) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-9b6459fa-56bb-4cc0-81ab-e01a9a4c29a1 req-10a79127-5f2c-498f-900f-f6cb4965b4fe service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-vif-unplugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b6459fa-56bb-4cc0-81ab-e01a9a4c29a1 req-10a79127-5f2c-498f-900f-f6cb4965b4fe service nova] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b6459fa-56bb-4cc0-81ab-e01a9a4c29a1 req-10a79127-5f2c-498f-900f-f6cb4965b4fe service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b6459fa-56bb-4cc0-81ab-e01a9a4c29a1 req-10a79127-5f2c-498f-900f-f6cb4965b4fe service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-9b6459fa-56bb-4cc0-81ab-e01a9a4c29a1 req-10a79127-5f2c-498f-900f-f6cb4965b4fe service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] No waiting events found dispatching network-vif-unplugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:59:48 user nova-compute[75260]: WARNING nova.compute.manager [req-9b6459fa-56bb-4cc0-81ab-e01a9a4c29a1 req-10a79127-5f2c-498f-900f-f6cb4965b4fe service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received unexpected event network-vif-unplugged-98655667-82da-4c3f-8724-e58493868afe for instance with vm_state active and task_state resize_migrating.
Nov 27 04:59:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:59:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:59:49 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Instance destroyed successfully.
Nov 27 04:59:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2106560057',display_name='tempest-ServerActionsTestOtherA-server-2106560057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2106560057',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOij+0g1QbUNojcJl3yIM3Tv96IeOdvkNKm5ThbXwXoQhcjwE76rap7fFhOUAjRiN20jCHkXP7XPhGl+HzdyShkrkNHzkMrulgl7gxlMCqAAOAl9YSxm9bSuYOmPOCmkIw==',key_name='tempest-keypair-1643056830',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-tj0rxw1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=37cf41f0-c27b-4e5c-bc20-1b7d79daac1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806040890-network", "vif_mac": "fa:16:3e:41:ff:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806040890-network", "vif_mac": "fa:16:3e:41:ff:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_vif [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98655667-82, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e574e33d-dbdc-4d1c-a529-5d9a4112536c) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:59:49 user nova-compute[75260]: INFO os_vif [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82')
Nov 27 04:59:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlxOncWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:59:49 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[501e0772-a432-4f4c-80c2-7fa275365592]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:59:49 user nova-compute[75260]: No targets found.
Nov 27 04:59:49 user nova-compute[75260]: iSNS:
Nov 27 04:59:49 user nova-compute[75260]: No targets found.
Nov 27 04:59:49 user nova-compute[75260]: STATIC:
Nov 27 04:59:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca
Nov 27 04:59:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:59:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:59:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 04:59:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:59:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:59:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 04:59:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:59:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:59:49 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e
Nov 27 04:59:49 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:59:49 user nova-compute[75260]:                 Iface Name: default
Nov 27 04:59:49 user nova-compute[75260]: FIRMWARE:
Nov 27 04:59:49 user nova-compute[75260]: No targets found.
Nov 27 04:59:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:59:49 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:59:49 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5755375-fbe6-470c-b05b-764863bef1a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc3a30c-ed16-45e2-963d-34950ccd2cb1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:59:49 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:59:49 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:59:49 user nova-compute[75260]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)
Nov 27 04:59:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:59:49 user nova-compute[75260]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:59:49 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:59:49 user nova-compute[75260]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)
Nov 27 04:59:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb541ba290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[035dcf7a-5784-4555-8c0f-f9f870172e04]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf1716b-7c5f-4f10-8d38-3151a29db7db]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2557b7b-b3c8-4e8b-82d5-fce496cbc63f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb05106d-1213-4eb2-ad06-365b79b63b7f]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fa902f-b67a-47f0-bdd3-71540dfe5668]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ade9cb5-da4b-47e4-81af-18e268f0a3e0]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260]
Nov 27 04:59:49 user nova-compute[75260]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260] successful.
Nov 27 04:59:49 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f8e9f8-be48-4c81-8491-4022182280cf]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== disconnect_volume: return (327ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:59:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 04:59:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-d76695ab-e385-4512-8188-125972b3bf5c req-5f51fc88-7cc6-4ee3-9be4-5a23db0baa55 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:59:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d76695ab-e385-4512-8188-125972b3bf5c req-5f51fc88-7cc6-4ee3-9be4-5a23db0baa55 service nova] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:59:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d76695ab-e385-4512-8188-125972b3bf5c req-5f51fc88-7cc6-4ee3-9be4-5a23db0baa55 service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:59:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d76695ab-e385-4512-8188-125972b3bf5c req-5f51fc88-7cc6-4ee3-9be4-5a23db0baa55 service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:59:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-d76695ab-e385-4512-8188-125972b3bf5c req-5f51fc88-7cc6-4ee3-9be4-5a23db0baa55 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] No waiting events found dispatching network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:59:50 user nova-compute[75260]: WARNING nova.compute.manager [req-d76695ab-e385-4512-8188-125972b3bf5c req-5f51fc88-7cc6-4ee3-9be4-5a23db0baa55 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received unexpected event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe for instance with vm_state active and task_state resize_migrating.
Nov 27 04:59:50 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Port 98655667-82da-4c3f-8724-e58493868afe binding to destination host user is already ACTIVE {{(pid=75260) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 27 04:59:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:59:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:59:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquired lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating instance_info_cache with network_info: [{"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Releasing lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG os_brick.utils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a2018d-8a9b-4478-972e-a4db1b00fc9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a875c8-bdcf-4004-a0f0-9e7c03df8cc1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5998a1e-4845-4c28-9d08-6b72086c202f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0105ed9d-958d-4595-b487-030e0ed40bd4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:59:51 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:59:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[24863d10-738c-4ae2-90f9-f0fbf7483db5]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:59:51 user nova-compute[75260]: DEBUG os_brick.utils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:59:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:59:52 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:59:53 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:59:53 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:59:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:59:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:59:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:59:54 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:59:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:54 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Updating instance_info_cache with network_info: [{"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:59:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:59:54 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:59:54 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:59:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:56 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:59:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Starting finish_migration {{(pid=75260) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Instance directory exists: not creating {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 04:59:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Creating image(s)
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Ensure instance console log exists: /opt/stack/data/nova/instances/37cf41f0-c27b-4e5c-bc20-1b7d79daac1d/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Start _get_guest_xml network_info=[{"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806040890-network", "vif_mac": "fa:16:3e:41:ff:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'e63f31bd-70aa-442f-95ed-4eb2c366e6ef', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlxOncWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '37cf41f0-c27b-4e5c-bc20-1b7d79daac1d', 'attached_at': '2023-11-27T04:59:58.000000', 'detached_at': '', 'volume_id': '7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 'serial': '7df351ca-661d-479f-b9b0-d7fa7dc6e3fe'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 04:59:58 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:59:58 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlxOncWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:59:58 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:59:58 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:59:58 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[657a625b-0d20-4baa-b0ce-901c7b2532ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:59:58 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.060s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[905a8a4b-2f98-4537-8666-4486415fa092]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe] added
Nov 27 04:59:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ed2eed-bbbe-46dc-b6db-499cf3814a85]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1216e9c0-7a42-4dc4-b012-296e232b5b34]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlxOncWD {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlxOncWD" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7677dea5-4122-4b4e-9e13-baf32d5c53d3]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XlxOncWD'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e52335-e660-44a9-a08a-75cb004b2754]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[011c06d1-6bd7-4258-8e8e-e10db8ef022b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:59:58 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:59:58 user nova-compute[75260]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)
Nov 27 04:59:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:59:58 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:59:58 user nova-compute[75260]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)
Nov 27 04:59:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[086b5603-6a59-4802-afe4-35424452fba9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260]
Nov 27 04:59:58 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260] successful.
Nov 27 04:59:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a548f567-2e5c-4c96-a78e-ffe7ad683e71]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[98156fca-686b-4e07-ab6d-eea93e1f2051]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:59:58 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:59:58 user nova-compute[75260]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)
Nov 27 04:59:58 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:59:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 04:59:58 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 04:59:58 user nova-compute[75260]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)
Nov 27 04:59:58 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 04:59:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e726ea65-178c-45b0-ab68-15a8c08b7568]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:59:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlxOncWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23438373864323337', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438373864323337', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2106560057',display_name='tempest-ServerActionsTestOtherA-server-2106560057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2106560057',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOij+0g1QbUNojcJl3yIM3Tv96IeOdvkNKm5ThbXwXoQhcjwE76rap7fFhOUAjRiN20jCHkXP7XPhGl+HzdyShkrkNHzkMrulgl7gxlMCqAAOAl9YSxm9bSuYOmPOCmkIw==',key_name='tempest-keypair-1643056830',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-tj0rxw1j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=37cf41f0-c27b-4e5c-bc20-1b7d79daac1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806040890-network", "vif_mac": "fa:16:3e:41:ff:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806040890-network", "vif_mac": "fa:16:3e:41:ff:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] End _get_guest_xml xml=<domain type="kvm">
Nov 27 04:59:59 user nova-compute[75260]:   <uuid>37cf41f0-c27b-4e5c-bc20-1b7d79daac1d</uuid>
Nov 27 04:59:59 user nova-compute[75260]:   <name>instance-00000027</name>
Nov 27 04:59:59 user nova-compute[75260]:   <memory>2097152</memory>
Nov 27 04:59:59 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 04:59:59 user nova-compute[75260]:   <metadata>
Nov 27 04:59:59 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 04:59:59 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 04:59:59 user nova-compute[75260]:       <nova:name>tempest-ServerActionsTestOtherA-server-2106560057</nova:name>
Nov 27 04:59:59 user nova-compute[75260]:       <nova:creationTime>2023-11-27 04:59:58</nova:creationTime>
Nov 27 04:59:59 user nova-compute[75260]:       <nova:flavor name="m1.small">
Nov 27 04:59:59 user nova-compute[75260]:         <nova:memory>2048</nova:memory>
Nov 27 04:59:59 user nova-compute[75260]:         <nova:disk>20</nova:disk>
Nov 27 04:59:59 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 04:59:59 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 04:59:59 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 04:59:59 user nova-compute[75260]:       </nova:flavor>
Nov 27 04:59:59 user nova-compute[75260]:       <nova:owner>
Nov 27 04:59:59 user nova-compute[75260]:         <nova:user uuid="71baa1a857c5458ea2d03515ea2ccaf3">tempest-ServerActionsTestOtherA-678795315-project-member</nova:user>
Nov 27 04:59:59 user nova-compute[75260]:         <nova:project uuid="a344ddbabc8e48e9987d8aa73042821a">tempest-ServerActionsTestOtherA-678795315</nova:project>
Nov 27 04:59:59 user nova-compute[75260]:       </nova:owner>
Nov 27 04:59:59 user nova-compute[75260]:       <nova:ports>
Nov 27 04:59:59 user nova-compute[75260]:         <nova:port uuid="98655667-82da-4c3f-8724-e58493868afe">
Nov 27 04:59:59 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 04:59:59 user nova-compute[75260]:         </nova:port>
Nov 27 04:59:59 user nova-compute[75260]:       </nova:ports>
Nov 27 04:59:59 user nova-compute[75260]:     </nova:instance>
Nov 27 04:59:59 user nova-compute[75260]:   </metadata>
Nov 27 04:59:59 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 04:59:59 user nova-compute[75260]:     <system>
Nov 27 04:59:59 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 04:59:59 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 04:59:59 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 04:59:59 user nova-compute[75260]:       <entry name="serial">37cf41f0-c27b-4e5c-bc20-1b7d79daac1d</entry>
Nov 27 04:59:59 user nova-compute[75260]:       <entry name="uuid">37cf41f0-c27b-4e5c-bc20-1b7d79daac1d</entry>
Nov 27 04:59:59 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 04:59:59 user nova-compute[75260]:     </system>
Nov 27 04:59:59 user nova-compute[75260]:   </sysinfo>
Nov 27 04:59:59 user nova-compute[75260]:   <os>
Nov 27 04:59:59 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 04:59:59 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 04:59:59 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 04:59:59 user nova-compute[75260]:   </os>
Nov 27 04:59:59 user nova-compute[75260]:   <features>
Nov 27 04:59:59 user nova-compute[75260]:     <acpi/>
Nov 27 04:59:59 user nova-compute[75260]:     <apic/>
Nov 27 04:59:59 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 04:59:59 user nova-compute[75260]:   </features>
Nov 27 04:59:59 user nova-compute[75260]:   <clock offset="utc">
Nov 27 04:59:59 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 04:59:59 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 04:59:59 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 04:59:59 user nova-compute[75260]:   </clock>
Nov 27 04:59:59 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 04:59:59 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 04:59:59 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 04:59:59 user nova-compute[75260]:   </cpu>
Nov 27 04:59:59 user nova-compute[75260]:   <devices>
Nov 27 04:59:59 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 04:59:59 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:59:59 user nova-compute[75260]:       <source dev="/dev/sdc"/>
Nov 27 04:59:59 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 04:59:59 user nova-compute[75260]:       <serial>7df351ca-661d-479f-b9b0-d7fa7dc6e3fe</serial>
Nov 27 04:59:59 user nova-compute[75260]:     </disk>
Nov 27 04:59:59 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 04:59:59 user nova-compute[75260]:       <mac address="fa:16:3e:41:ff:72"/>
Nov 27 04:59:59 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:59:59 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 04:59:59 user nova-compute[75260]:       <target dev="tap98655667-82"/>
Nov 27 04:59:59 user nova-compute[75260]:     </interface>
Nov 27 04:59:59 user nova-compute[75260]:     <serial type="pty">
Nov 27 04:59:59 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/37cf41f0-c27b-4e5c-bc20-1b7d79daac1d/console.log" append="off"/>
Nov 27 04:59:59 user nova-compute[75260]:     </serial>
Nov 27 04:59:59 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 04:59:59 user nova-compute[75260]:     <video>
Nov 27 04:59:59 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 04:59:59 user nova-compute[75260]:     </video>
Nov 27 04:59:59 user nova-compute[75260]:     <rng model="virtio">
Nov 27 04:59:59 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 04:59:59 user nova-compute[75260]:     </rng>
Nov 27 04:59:59 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 04:59:59 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 04:59:59 user nova-compute[75260]:       <stats period="10"/>
Nov 27 04:59:59 user nova-compute[75260]:     </memballoon>
Nov 27 04:59:59 user nova-compute[75260]:   </devices>
Nov 27 04:59:59 user nova-compute[75260]: </domain>
Nov 27 04:59:59 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2106560057',display_name='tempest-ServerActionsTestOtherA-server-2106560057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2106560057',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOij+0g1QbUNojcJl3yIM3Tv96IeOdvkNKm5ThbXwXoQhcjwE76rap7fFhOUAjRiN20jCHkXP7XPhGl+HzdyShkrkNHzkMrulgl7gxlMCqAAOAl9YSxm9bSuYOmPOCmkIw==',key_name='tempest-keypair-1643056830',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-tj0rxw1j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T04:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=37cf41f0-c27b-4e5c-bc20-1b7d79daac1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806040890-network", "vif_mac": "fa:16:3e:41:ff:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1806040890-network", "vif_mac": "fa:16:3e:41:ff:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG os_vif [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52eae947-6541-5934-9f2e-a0b8733d0cfd', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98655667-82, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98655667-82, col_values=(('qos', UUID('59618284-9b4c-4475-bb58-96921c5566be')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98655667-82, col_values=(('external_ids', {'iface-id': '98655667-82da-4c3f-8724-e58493868afe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:ff:72', 'vm-uuid': '37cf41f0-c27b-4e5c-bc20-1b7d79daac1d'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:59:59 user nova-compute[75260]: INFO os_vif [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82')
Nov 27 04:59:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:59:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] No VIF found with MAC fa:16:3e:41:ff:72, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:00:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:01 user nova-compute[75260]: DEBUG nova.compute.manager [req-46780278-fc14-4d11-9a29-9e0c57698fad req-1bc9594d-acfb-4442-b6c4-590ba8e61c75 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:00:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-46780278-fc14-4d11-9a29-9e0c57698fad req-1bc9594d-acfb-4442-b6c4-590ba8e61c75 service nova] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-46780278-fc14-4d11-9a29-9e0c57698fad req-1bc9594d-acfb-4442-b6c4-590ba8e61c75 service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-46780278-fc14-4d11-9a29-9e0c57698fad req-1bc9594d-acfb-4442-b6c4-590ba8e61c75 service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:01 user nova-compute[75260]: DEBUG nova.compute.manager [req-46780278-fc14-4d11-9a29-9e0c57698fad req-1bc9594d-acfb-4442-b6c4-590ba8e61c75 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] No waiting events found dispatching network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:00:01 user nova-compute[75260]: WARNING nova.compute.manager [req-46780278-fc14-4d11-9a29-9e0c57698fad req-1bc9594d-acfb-4442-b6c4-590ba8e61c75 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received unexpected event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe for instance with vm_state active and task_state resize_finish.
Nov 27 05:00:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:00:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:00:03 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Instance running successfully.
Nov 27 05:00:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Failed to set time: agent not configured {{(pid=75260) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3980b60b-6c48-45ad-b765-a9ff8071880d tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] finish_migration finished successfully. {{(pid=75260) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-f14b2c3e-2673-4c7b-9b84-fb9ca3eeec02 req-076c58b1-373d-4766-b950-f6dd39f4ec9a service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f14b2c3e-2673-4c7b-9b84-fb9ca3eeec02 req-076c58b1-373d-4766-b950-f6dd39f4ec9a service nova] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f14b2c3e-2673-4c7b-9b84-fb9ca3eeec02 req-076c58b1-373d-4766-b950-f6dd39f4ec9a service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f14b2c3e-2673-4c7b-9b84-fb9ca3eeec02 req-076c58b1-373d-4766-b950-f6dd39f4ec9a service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:03 user nova-compute[75260]: DEBUG nova.compute.manager [req-f14b2c3e-2673-4c7b-9b84-fb9ca3eeec02 req-076c58b1-373d-4766-b950-f6dd39f4ec9a service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] No waiting events found dispatching network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:00:03 user nova-compute[75260]: WARNING nova.compute.manager [req-f14b2c3e-2673-4c7b-9b84-fb9ca3eeec02 req-076c58b1-373d-4766-b950-f6dd39f4ec9a service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received unexpected event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe for instance with vm_state active and task_state resize_finish.
Nov 27 05:00:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:04 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:00:04 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8089MB free_disk=25.172603607177734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Applying migration context for instance 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d as it has an incoming, in-progress migration 6f2a7f9c-a756-4a0b-a4e6-62e2a6cf4c50. Migration status is finished {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 05:00:04 user nova-compute[75260]: INFO nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating resource usage from migration 6f2a7f9c-a756-4a0b-a4e6-62e2a6cf4c50
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1a25081f-79d1-412f-bf99-4235516d40a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4bff94d1-4400-4dff-baff-fc10c8070b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4f619b72-fa16-4ae8-8693-00b8d2fa5910 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance c037e01b-1dad-48e3-9df9-187ebb3c3587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Migration 6f2a7f9c-a756-4a0b-a4e6-62e2a6cf4c50 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing inventories for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating ProviderTree inventory for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing aggregate associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, aggregates: None {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing trait associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] There are 0 instances to clean {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75260) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 05:00:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-d208d263-8c03-4477-9a8a-b7f00a6e2f91 req-6a60f9ff-b660-4019-9235-cb2a5e95cd41 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-changed-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:00:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-d208d263-8c03-4477-9a8a-b7f00a6e2f91 req-6a60f9ff-b660-4019-9235-cb2a5e95cd41 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Refreshing instance network info cache due to event network-changed-98eae3b9-3a88-4152-a0f4-feef155827e0. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:00:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d208d263-8c03-4477-9a8a-b7f00a6e2f91 req-6a60f9ff-b660-4019-9235-cb2a5e95cd41 service nova] Acquiring lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:00:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d208d263-8c03-4477-9a8a-b7f00a6e2f91 req-6a60f9ff-b660-4019-9235-cb2a5e95cd41 service nova] Acquired lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:00:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-d208d263-8c03-4477-9a8a-b7f00a6e2f91 req-6a60f9ff-b660-4019-9235-cb2a5e95cd41 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Refreshing network info cache for port 98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:00:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-d208d263-8c03-4477-9a8a-b7f00a6e2f91 req-6a60f9ff-b660-4019-9235-cb2a5e95cd41 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updated VIF entry in instance network info cache for port 98eae3b9-3a88-4152-a0f4-feef155827e0. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:00:07 user nova-compute[75260]: DEBUG nova.network.neutron [req-d208d263-8c03-4477-9a8a-b7f00a6e2f91 req-6a60f9ff-b660-4019-9235-cb2a5e95cd41 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating instance_info_cache with network_info: [{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:00:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d208d263-8c03-4477-9a8a-b7f00a6e2f91 req-6a60f9ff-b660-4019-9235-cb2a5e95cd41 service nova] Releasing lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:00:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:08 user nova-compute[75260]: INFO nova.compute.manager [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Shelve offloading
Nov 27 05:00:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:08 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 is timed out.
Nov 27 05:00:09 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Successfully detached device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the live domain config.
Nov 27 05:00:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aQfGKnyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:00:09 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:09 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Instance destroyed successfully.
Nov 27 05:00:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquired lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG nova.network.neutron [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8fbaa4-61da-412b-9895-f01e3d5fbdd0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:00:09 user nova-compute[75260]: No targets found.
Nov 27 05:00:09 user nova-compute[75260]: iSNS:
Nov 27 05:00:09 user nova-compute[75260]: No targets found.
Nov 27 05:00:09 user nova-compute[75260]: STATIC:
Nov 27 05:00:09 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca
Nov 27 05:00:09 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:00:09 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:00:09 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:00:09 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:00:09 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:00:09 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 05:00:09 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:00:09 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:00:09 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e
Nov 27 05:00:09 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:00:09 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:00:09 user nova-compute[75260]: FIRMWARE:
Nov 27 05:00:09 user nova-compute[75260]: No targets found.
Nov 27 05:00:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:00:09 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:00:09 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5896f4-3a8c-4b4d-b8e7-a4dabfbb951d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eb14f1-9c2e-4bfe-b0ec-013828fe16cc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:09 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:00:09 user nova-compute[75260]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)
Nov 27 05:00:09 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:09 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:00:09 user nova-compute[75260]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca (non-flash)
Nov 27 05:00:09 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb542a0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca'): ({'sde'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Removing single pathed devices sde {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f285b-2e4a-4e51-b2ab-fb35e92101a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaedd3c-6a20-4f87-8ca7-196bdc7a4b07]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Flushing IO for device /dev/sde {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2ca4a-b445-4b94-8cbb-b24e67c6417b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5a819a-b130-422b-a11f-df28c6e9f72c]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c033c3-2fd8-45ac-8979-361d7e0be2cd]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-unplugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-unplugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:00:09 user nova-compute[75260]: WARNING nova.compute.manager [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received unexpected event network-vif-unplugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with vm_state active and task_state shelving.
Nov 27 05:00:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:00:09 user nova-compute[75260]: WARNING nova.compute.manager [req-10bbe20f-50aa-4989-a120-946d34f22eda req-850f4215-85bc-477e-ba21-a1625e976350 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received unexpected event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with vm_state active and task_state shelving.
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[028f5b0a-040b-4b04-a597-4665927d29a0]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca, portal: 172.16.0.220,3260]
Nov 27 05:00:09 user nova-compute[75260]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca, portal: 172.16.0.220,3260] successful.
Nov 27 05:00:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3a0dc-217a-4f8b-8843-52eea69054ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a598fd-70ed-4ac5-9798-61fcc493c1b9]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== disconnect_volume: return (373ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG nova.network.neutron [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating instance_info_cache with network_info: [{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Releasing lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:00:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:10 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Instance destroyed successfully.
Nov 27 05:00:10 user nova-compute[75260]: DEBUG nova.objects.instance [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lazy-loading 'resources' on Instance uuid 4f619b72-fa16-4ae8-8693-00b8d2fa5910 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1751229513',display_name='tempest-TestShelveInstance-server-1751229513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1751229513',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTjm39bq9T3Aj9FAOay1ZJVrSQPO1ihgbXN1DUbPUuuVmLiFKRDNNnD6W9uzjR++u8JrbTp6q95i4UZh9F8GHb11y8Dz1R3heMWfS6Cxl4yoYMnLOlSvj4cXiW8AYfO0w==',key_name='tempest-TestShelveInstance-141016732',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:58:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bdd9716601a4207b876ddcffff6458c',ramdisk_id='',reservation_id='r-ilmv1pst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1324535314',owner_user_name='tempest-TestShelveInstance-1324535314-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:58:29Z,user_data=None,user_id='2e48682a815e4ec38876b91a70718ed2',uuid=4f619b72-fa16-4ae8-8693-00b8d2fa5910,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converting VIF {"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_vif [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98eae3b9-3a, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d79f80f-c3d0-4d20-9ea8-9c4c9bbc828f) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:00:10 user nova-compute[75260]: INFO os_vif [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a')
Nov 27 05:00:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASLuoGVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:00:10 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13afd6b-c597-4cb6-b93d-2901009ca700]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:00:10 user nova-compute[75260]: No targets found.
Nov 27 05:00:10 user nova-compute[75260]: iSNS:
Nov 27 05:00:10 user nova-compute[75260]: No targets found.
Nov 27 05:00:10 user nova-compute[75260]: STATIC:
Nov 27 05:00:10 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:00:10 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:00:10 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:00:10 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 05:00:10 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:00:10 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:00:10 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e
Nov 27 05:00:10 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:00:10 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:00:10 user nova-compute[75260]: FIRMWARE:
Nov 27 05:00:10 user nova-compute[75260]: No targets found.
Nov 27 05:00:10 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:00:10 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:00:10 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cbf2f3-363c-48ae-8d79-248dec3f4d51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8158d12-30b3-451c-9f85-c4261bb96007]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:10 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:00:10 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:10 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:10 user nova-compute[75260]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:00:10 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:10 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb542225f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b633d9-7724-4237-b9f3-e47c07b424cc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04fc978-6362-4e00-ad37-4ad72d3e606a]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2be0cb4-b8a6-420d-991f-044254f46ad2]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a661cdf9-c00b-45ce-afd7-22ad40422a5f]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6302c10-8eb7-4618-a147-2de2e2e189ee]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50948b3-c3d9-4d89-bef1-86e3a8ef8124]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260]
Nov 27 05:00:10 user nova-compute[75260]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260] successful.
Nov 27 05:00:10 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a7755f-c594-43a4-8e66-9b0219483ff4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] <== disconnect_volume: return (312ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:00:10 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Deleting instance files /opt/stack/data/nova/instances/4f619b72-fa16-4ae8-8693-00b8d2fa5910_del
Nov 27 05:00:10 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Deletion of /opt/stack/data/nova/instances/4f619b72-fa16-4ae8-8693-00b8d2fa5910_del complete
Nov 27 05:00:10 user nova-compute[75260]: DEBUG nova.compute.manager [req-acff8deb-da87-4f93-a33d-5f68ef5cf240 req-ec7884c7-1275-4e20-93e9-c01769710070 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-changed-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG nova.compute.manager [req-acff8deb-da87-4f93-a33d-5f68ef5cf240 req-ec7884c7-1275-4e20-93e9-c01769710070 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Refreshing instance network info cache due to event network-changed-98eae3b9-3a88-4152-a0f4-feef155827e0. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-acff8deb-da87-4f93-a33d-5f68ef5cf240 req-ec7884c7-1275-4e20-93e9-c01769710070 service nova] Acquiring lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-acff8deb-da87-4f93-a33d-5f68ef5cf240 req-ec7884c7-1275-4e20-93e9-c01769710070 service nova] Acquired lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:00:10 user nova-compute[75260]: DEBUG nova.network.neutron [req-acff8deb-da87-4f93-a33d-5f68ef5cf240 req-ec7884c7-1275-4e20-93e9-c01769710070 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Refreshing network info cache for port 98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:00:11 user nova-compute[75260]: DEBUG nova.network.neutron [req-acff8deb-da87-4f93-a33d-5f68ef5cf240 req-ec7884c7-1275-4e20-93e9-c01769710070 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updated VIF entry in instance network info cache for port 98eae3b9-3a88-4152-a0f4-feef155827e0. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:00:11 user nova-compute[75260]: DEBUG nova.network.neutron [req-acff8deb-da87-4f93-a33d-5f68ef5cf240 req-ec7884c7-1275-4e20-93e9-c01769710070 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating instance_info_cache with network_info: [{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": null, "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:00:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-acff8deb-da87-4f93-a33d-5f68ef5cf240 req-ec7884c7-1275-4e20-93e9-c01769710070 service nova] Releasing lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:00:11 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Deleted allocations for instance 4f619b72-fa16-4ae8-8693-00b8d2fa5910
Nov 27 05:00:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:11 user nova-compute[75260]: DEBUG nova.objects.instance [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f619b72-fa16-4ae8-8693-00b8d2fa5910 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:00:11 user nova-compute[75260]: DEBUG nova.objects.base [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Object Instance<4f619b72-fa16-4ae8-8693-00b8d2fa5910> lazy-loaded attributes: resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:00:12 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:00:12 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:00:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-407f04c1-94be-4dc2-911c-35c4d6204b97 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.979s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:00:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:13 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:00:13 user nova-compute[75260]: INFO nova.compute.claims [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Claim successful on node user
Nov 27 05:00:13 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:00:14 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:00:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:00:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:00:14 user nova-compute[75260]: DEBUG nova.network.neutron [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:00:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:00:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:00:14 user nova-compute[75260]: DEBUG nova.policy [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05cdf3b00bfe4f728e7fa4e17eba3c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eada319615449deb2152f59ba3d3e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:00:14 user nova-compute[75260]: INFO nova.virt.block_device [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Booting with volume-backed-image a58facc7-83af-4098-886e-ccf8b18b0095 at /dev/vda
Nov 27 05:00:14 user nova-compute[75260]: DEBUG nova.network.neutron [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Successfully created port: fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Successfully updated port: fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquired lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-6186f683-22f2-45ba-987a-2c33c6fc8ab6 req-ffdcffc8-8cf6-46a5-8e2e-9822082390a5 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-changed-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-6186f683-22f2-45ba-987a-2c33c6fc8ab6 req-ffdcffc8-8cf6-46a5-8e2e-9822082390a5 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Refreshing instance network info cache due to event network-changed-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6186f683-22f2-45ba-987a-2c33c6fc8ab6 req-ffdcffc8-8cf6-46a5-8e2e-9822082390a5 service nova] Acquiring lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG nova.network.neutron [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Updating instance_info_cache with network_info: [{"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Releasing lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Instance network_info: |[{"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6186f683-22f2-45ba-987a-2c33c6fc8ab6 req-ffdcffc8-8cf6-46a5-8e2e-9822082390a5 service nova] Acquired lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:00:15 user nova-compute[75260]: DEBUG nova.network.neutron [req-6186f683-22f2-45ba-987a-2c33c6fc8ab6 req-ffdcffc8-8cf6-46a5-8e2e-9822082390a5 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Refreshing network info cache for port fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:00:16 user nova-compute[75260]: DEBUG nova.network.neutron [req-6186f683-22f2-45ba-987a-2c33c6fc8ab6 req-ffdcffc8-8cf6-46a5-8e2e-9822082390a5 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Updated VIF entry in instance network info cache for port fbf4036b-0b1f-43b1-8bb0-a612d17b6eed. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:00:16 user nova-compute[75260]: DEBUG nova.network.neutron [req-6186f683-22f2-45ba-987a-2c33c6fc8ab6 req-ffdcffc8-8cf6-46a5-8e2e-9822082390a5 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Updating instance_info_cache with network_info: [{"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:00:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6186f683-22f2-45ba-987a-2c33c6fc8ab6 req-ffdcffc8-8cf6-46a5-8e2e-9822082390a5 service nova] Releasing lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:00:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:17 user nova-compute[75260]: DEBUG nova.objects.instance [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:00:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-70e03b3a-9820-4157-a6d5-c85e64a0a1ce tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.800s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:19 user nova-compute[75260]: DEBUG os_brick.utils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:00:19 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f032efd4-ee53-43e2-850c-fe0c8d6e3585]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef95d00-a7c3-485b-8365-342060f7aa18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[822968e4-906b-4d68-b6d3-eb617c5833e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27895b0-a98b-4f04-bb93-64fe27b399ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:00:20 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:00:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfc0283-2d3d-4650-8cb4-671b3d411835]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG os_brick.utils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Updating existing volume attachment record: e9922db9-3da1-4333-a4fb-bb9f8358971d {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:00:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:00:27 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Creating image(s)
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Ensure instance console log exists: /opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Start _get_guest_xml network_info=[{"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'e9922db9-3da1-4333-a4fb-bb9f8358971d', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqnuVtHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25fc2351-09a3-4d9f-83b7-485677fa8caf', 'attached_at': '', 'detached_at': '', 'volume_id': 'a94b53a7-5ce0-4595-a1d2-343ab4232e69', 'serial': 'a94b53a7-5ce0-4595-a1d2-343ab4232e69'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:00:27 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:00:27 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqnuVtHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:00:27 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:00:27 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:00:27 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5027977c-38b6-48e4-926a-90655f9f04de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:00:27 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a2a946-16e3-4ca1-b066-432d798713cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69] added
Nov 27 05:00:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9531c6c-030a-40ce-8b1a-18de0b4cdc93]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5387001-2292-4a3f-bfaf-b1b3cdd4f9ea]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hqnuVtHD {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hqnuVtHD" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e7de9b-f860-4119-851e-2e1bfb89c027]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hqnuVtHD'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[75379e68-4f73-4cf1-a698-9eed0d4f5b34]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e865b0ac-c62b-4e6a-8f4b-2d9376e8d3ab]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:27 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:27 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5b4738-cf7e-4dff-a4ab-5c8631645a09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69, portal: 172.16.0.220,3260]
Nov 27 05:00:27 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69, portal: 172.16.0.220,3260] successful.
Nov 27 05:00:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9658f36f-51cc-4cfc-aaf7-04dde21e27fc]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[59741f71-8d0e-4890-9767-9869733881a8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:27 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:27 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:00:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:27 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:27 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:00:27 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d976c3-9c2e-4981-aa25-ea423db2f444]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:27 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqnuVtHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23936633964356332', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936633964356332', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-473047943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-473047943',id=42,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-buyu0ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:00:14Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=25fc2351-09a3-4d9f-83b7-485677fa8caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:ca:01,bridge_name='br-int',has_traffic_filtering=True,id=fbf4036b-0b1f-43b1-8bb0-a612d17b6eed,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf4036b-0b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'pci_devices' on Instance uuid 25fc2351-09a3-4d9f-83b7-485677fa8caf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:00:28 user nova-compute[75260]:   <uuid>25fc2351-09a3-4d9f-83b7-485677fa8caf</uuid>
Nov 27 05:00:28 user nova-compute[75260]:   <name>instance-0000002a</name>
Nov 27 05:00:28 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:00:28 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:00:28 user nova-compute[75260]:   <metadata>
Nov 27 05:00:28 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:00:28 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:00:28 user nova-compute[75260]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-473047943</nova:name>
Nov 27 05:00:28 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:00:27</nova:creationTime>
Nov 27 05:00:28 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:00:28 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:00:28 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:00:28 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:00:28 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:00:28 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:00:28 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:00:28 user nova-compute[75260]:       <nova:owner>
Nov 27 05:00:28 user nova-compute[75260]:         <nova:user uuid="05cdf3b00bfe4f728e7fa4e17eba3c4e">tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member</nova:user>
Nov 27 05:00:28 user nova-compute[75260]:         <nova:project uuid="7eada319615449deb2152f59ba3d3e6d">tempest-ServerBootFromVolumeStableRescueTest-293744143</nova:project>
Nov 27 05:00:28 user nova-compute[75260]:       </nova:owner>
Nov 27 05:00:28 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 05:00:28 user nova-compute[75260]:       <nova:ports>
Nov 27 05:00:28 user nova-compute[75260]:         <nova:port uuid="fbf4036b-0b1f-43b1-8bb0-a612d17b6eed">
Nov 27 05:00:28 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 05:00:28 user nova-compute[75260]:         </nova:port>
Nov 27 05:00:28 user nova-compute[75260]:       </nova:ports>
Nov 27 05:00:28 user nova-compute[75260]:     </nova:instance>
Nov 27 05:00:28 user nova-compute[75260]:   </metadata>
Nov 27 05:00:28 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:00:28 user nova-compute[75260]:     <system>
Nov 27 05:00:28 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:00:28 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:00:28 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:00:28 user nova-compute[75260]:       <entry name="serial">25fc2351-09a3-4d9f-83b7-485677fa8caf</entry>
Nov 27 05:00:28 user nova-compute[75260]:       <entry name="uuid">25fc2351-09a3-4d9f-83b7-485677fa8caf</entry>
Nov 27 05:00:28 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:00:28 user nova-compute[75260]:     </system>
Nov 27 05:00:28 user nova-compute[75260]:   </sysinfo>
Nov 27 05:00:28 user nova-compute[75260]:   <os>
Nov 27 05:00:28 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:00:28 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:00:28 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:00:28 user nova-compute[75260]:   </os>
Nov 27 05:00:28 user nova-compute[75260]:   <features>
Nov 27 05:00:28 user nova-compute[75260]:     <acpi/>
Nov 27 05:00:28 user nova-compute[75260]:     <apic/>
Nov 27 05:00:28 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:00:28 user nova-compute[75260]:   </features>
Nov 27 05:00:28 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:00:28 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:00:28 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:00:28 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:00:28 user nova-compute[75260]:   </clock>
Nov 27 05:00:28 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:00:28 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:00:28 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:00:28 user nova-compute[75260]:   </cpu>
Nov 27 05:00:28 user nova-compute[75260]:   <devices>
Nov 27 05:00:28 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:00:28 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:00:28 user nova-compute[75260]:       <source dev="/dev/sdb"/>
Nov 27 05:00:28 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:00:28 user nova-compute[75260]:       <serial>a94b53a7-5ce0-4595-a1d2-343ab4232e69</serial>
Nov 27 05:00:28 user nova-compute[75260]:     </disk>
Nov 27 05:00:28 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:00:28 user nova-compute[75260]:       <mac address="fa:16:3e:ee:ca:01"/>
Nov 27 05:00:28 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:00:28 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:00:28 user nova-compute[75260]:       <target dev="tapfbf4036b-0b"/>
Nov 27 05:00:28 user nova-compute[75260]:     </interface>
Nov 27 05:00:28 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:00:28 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/console.log" append="off"/>
Nov 27 05:00:28 user nova-compute[75260]:     </serial>
Nov 27 05:00:28 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:00:28 user nova-compute[75260]:     <video>
Nov 27 05:00:28 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:00:28 user nova-compute[75260]:     </video>
Nov 27 05:00:28 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:00:28 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:00:28 user nova-compute[75260]:     </rng>
Nov 27 05:00:28 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:00:28 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:00:28 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:00:28 user nova-compute[75260]:     </memballoon>
Nov 27 05:00:28 user nova-compute[75260]:   </devices>
Nov 27 05:00:28 user nova-compute[75260]: </domain>
Nov 27 05:00:28 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-473047943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-473047943',id=42,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-buyu0ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:00:14Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=25fc2351-09a3-4d9f-83b7-485677fa8caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:ca:01,bridge_name='br-int',has_traffic_filtering=True,id=fbf4036b-0b1f-43b1-8bb0-a612d17b6eed,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf4036b-0b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG os_vif [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:ca:01,bridge_name='br-int',has_traffic_filtering=True,id=fbf4036b-0b1f-43b1-8bb0-a612d17b6eed,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf4036b-0b') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43a478be-6af1-5e02-886f-5f6eafae789b', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbf4036b-0b, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbf4036b-0b, col_values=(('qos', UUID('5319699f-2cdc-4526-a336-72189c4ee015')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbf4036b-0b, col_values=(('external_ids', {'iface-id': 'fbf4036b-0b1f-43b1-8bb0-a612d17b6eed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:ca:01', 'vm-uuid': '25fc2351-09a3-4d9f-83b7-485677fa8caf'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:28 user nova-compute[75260]: INFO os_vif [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:ca:01,bridge_name='br-int',has_traffic_filtering=True,id=fbf4036b-0b1f-43b1-8bb0-a612d17b6eed,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf4036b-0b')
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:00:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No VIF found with MAC fa:16:3e:ee:ca:01, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:00:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-568bcb11-2079-4caa-b02d-66e9e347f4a1 req-f57abf64-c1fa-4383-8642-991fe0dbc95b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:00:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-568bcb11-2079-4caa-b02d-66e9e347f4a1 req-f57abf64-c1fa-4383-8642-991fe0dbc95b service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-568bcb11-2079-4caa-b02d-66e9e347f4a1 req-f57abf64-c1fa-4383-8642-991fe0dbc95b service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-568bcb11-2079-4caa-b02d-66e9e347f4a1 req-f57abf64-c1fa-4383-8642-991fe0dbc95b service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-568bcb11-2079-4caa-b02d-66e9e347f4a1 req-f57abf64-c1fa-4383-8642-991fe0dbc95b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:00:30 user nova-compute[75260]: WARNING nova.compute.manager [req-568bcb11-2079-4caa-b02d-66e9e347f4a1 req-f57abf64-c1fa-4383-8642-991fe0dbc95b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state building and task_state spawning.
Nov 27 05:00:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:00:32 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Instance spawned successfully.
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:00:32 user nova-compute[75260]: INFO nova.compute.manager [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-baa1f549-7504-4737-8586-eb975dd582af req-bc208c46-5a8d-4568-b924-6769b6f4c4ee service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-baa1f549-7504-4737-8586-eb975dd582af req-bc208c46-5a8d-4568-b924-6769b6f4c4ee service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-baa1f549-7504-4737-8586-eb975dd582af req-bc208c46-5a8d-4568-b924-6769b6f4c4ee service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-baa1f549-7504-4737-8586-eb975dd582af req-bc208c46-5a8d-4568-b924-6769b6f4c4ee service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-baa1f549-7504-4737-8586-eb975dd582af req-bc208c46-5a8d-4568-b924-6769b6f4c4ee service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:00:32 user nova-compute[75260]: WARNING nova.compute.manager [req-baa1f549-7504-4737-8586-eb975dd582af req-bc208c46-5a8d-4568-b924-6769b6f4c4ee service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state building and task_state spawning.
Nov 27 05:00:32 user nova-compute[75260]: INFO nova.compute.manager [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Took 19.05 seconds to build instance.
Nov 27 05:00:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e663b33e-eab3-42d9-9cc1-66bd0396b539 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.174s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lazy-loading 'flavor' on Instance uuid c037e01b-1dad-48e3-9df9-187ebb3c3587 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:00:33 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Ignoring supplied device name: /dev/vdb
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:33 user nova-compute[75260]: INFO nova.compute.manager [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Attaching volume b55a2898-2097-4cfa-b0a0-b0193ce57686 to /dev/vdb
Nov 27 05:00:33 user nova-compute[75260]: DEBUG os_brick.utils [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e53421-d32d-4237-965c-10d70fcaa5b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3e4ad4-1b1d-4b2d-8068-138380650d5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:33 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c10a7ca-25a5-4abb-9348-67616f2795ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc28b18-6263-4f79-84b6-e10867372399]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:00:34 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:00:34 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ae9c68-2f4c-4ff7-b4f7-0da4f2c3eaa3]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG os_brick.utils [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Updating existing volume attachment record: 75b08b05-b593-4619-bcdc-62438ab30f32 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG nova.compute.manager [req-a2ebadea-f235-42f3-82db-41b4d06f8163 req-c34515b4-c72e-4d5b-adb7-2ba8f94396fa service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received event network-changed-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG nova.compute.manager [req-a2ebadea-f235-42f3-82db-41b4d06f8163 req-c34515b4-c72e-4d5b-adb7-2ba8f94396fa service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Refreshing instance network info cache due to event network-changed-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a2ebadea-f235-42f3-82db-41b4d06f8163 req-c34515b4-c72e-4d5b-adb7-2ba8f94396fa service nova] Acquiring lock "refresh_cache-c037e01b-1dad-48e3-9df9-187ebb3c3587" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a2ebadea-f235-42f3-82db-41b4d06f8163 req-c34515b4-c72e-4d5b-adb7-2ba8f94396fa service nova] Acquired lock "refresh_cache-c037e01b-1dad-48e3-9df9-187ebb3c3587" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:00:34 user nova-compute[75260]: DEBUG nova.network.neutron [req-a2ebadea-f235-42f3-82db-41b4d06f8163 req-c34515b4-c72e-4d5b-adb7-2ba8f94396fa service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Refreshing network info cache for port be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:00:35 user nova-compute[75260]: DEBUG nova.network.neutron [req-a2ebadea-f235-42f3-82db-41b4d06f8163 req-c34515b4-c72e-4d5b-adb7-2ba8f94396fa service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Updated VIF entry in instance network info cache for port be36c46d-0c0b-4055-a9d5-bc9e3908e7bf. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:00:35 user nova-compute[75260]: DEBUG nova.network.neutron [req-a2ebadea-f235-42f3-82db-41b4d06f8163 req-c34515b4-c72e-4d5b-adb7-2ba8f94396fa service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Updating instance_info_cache with network_info: [{"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:00:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a2ebadea-f235-42f3-82db-41b4d06f8163 req-c34515b4-c72e-4d5b-adb7-2ba8f94396fa service nova] Releasing lock "refresh_cache-c037e01b-1dad-48e3-9df9-187ebb3c3587" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:00:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdMtWvrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:00:40 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:00:40 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:00:40 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba6928e-b5d2-4599-9dd3-f8ccba28b296]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:00:40 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[16359b3d-b414-4663-aa74-914ee6b4a2c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686] added
Nov 27 05:00:40 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[539347d6-4600-4fdb-9b17-4aa7109c186d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94d8c4f-70cc-4434-bdc6-80aaf7a4afa4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdMtWvrD {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdMtWvrD" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5718f22-6fce-4504-a4cd-2f915f971c34]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sdMtWvrD'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[06347c49-9d6a-4391-81b8-5116135377ab]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9346fed0-b041-47e1-a4ff-9c3c04d9fe7f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:40 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:40 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:00:40 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:40 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:40 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:00:40 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8960dbaf-aca4-4f79-a221-379f60ed6f2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686, portal: 172.16.0.220,3260]
Nov 27 05:00:40 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686, portal: 172.16.0.220,3260] successful.
Nov 27 05:00:40 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ebf4ae-ecb9-4c56-a5d0-b733bd782802]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6040981a-ba31-4244-b91e-b67d9311584b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:41 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:41 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:00:41 user nova-compute[75260]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)
Nov 27 05:00:41 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:41 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:41 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:00:41 user nova-compute[75260]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)
Nov 27 05:00:41 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c40253-fe1b-4956-803a-908e78acee70]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:41 user nova-compute[75260]: INFO nova.compute.manager [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attaching volume 0d2339ea-d938-4c2a-a425-1376f5300388 to /dev/vdb
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.utils [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a00cdd-3b10-418f-adcc-a525eb84b1e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2b93f-e04b-4b2c-8220-3bb9663f6ea6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e2a471-5920-48db-8d7f-f8a490655063]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b17a7f6-0728-478f-851c-b0db575459d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:00:41 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:00:41 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d097b7-391d-468c-8214-0d92f0f2c64f]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG os_brick.utils [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:00:41 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updating existing volume attachment record: 3f81d258-41de-44d7-bbe3-62b7e578903e {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdMtWvrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26635363637376561', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635363637376561', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lazy-loading 'flavor' on Instance uuid c037e01b-1dad-48e3-9df9-187ebb3c3587 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 05:00:42 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:00:42 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:00:42 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:00:42 user nova-compute[75260]:   <serial>b55a2898-2097-4cfa-b0a0-b0193ce57686</serial>
Nov 27 05:00:42 user nova-compute[75260]: </disk>
Nov 27 05:00:42 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] No VIF found with MAC fa:16:3e:ab:09:64, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:00:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8ee32e80-fe13-4f96-a487-4a4ae4a7c1be tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.789s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMGzKZTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:00:48 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:00:48 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:00:48 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9823324-4c77-47a5-881e-10314597a335]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:00:48 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c8e3a7-17d8-4f3d-a6dc-9e52594c94de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388] added
Nov 27 05:00:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fca827-b723-4e21-9853-48928eb2a5e1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842668b-f767-4455-b9b2-cf60b4323e02]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMGzKZTg {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMGzKZTg" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf35ad42-8921-4b57-b395-202e577b5897]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMGzKZTg'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.060s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f4e59e-abfc-4fa5-9a69-14398c1c55df]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df74f99-5b74-412b-ac31-fffa8ed467c1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)
Nov 27 05:00:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)
Nov 27 05:00:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc549927-c9f0-48d4-876a-d3f4796b9e97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388, portal: 172.16.0.220,3260]
Nov 27 05:00:48 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388, portal: 172.16.0.220,3260] successful.
Nov 27 05:00:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a04baf0-9291-43a4-804a-e3c4c4133be5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a53b6e-5a1c-4e55-9971-6e12b166f906]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 (non-flash)
Nov 27 05:00:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)
Nov 27 05:00:48 user nova-compute[75260]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 (non-flash)
Nov 27 05:00:48 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e360e3f8-a122-42ed-9c6d-9ae4665b1966]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:00:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMGzKZTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:00:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:00:49 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26263396436326665', 'path': '/dev/sde'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:00:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263396436326665', 'path': '/dev/sde'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:00:49 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:00:49 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 05:00:49 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:00:49 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 05:00:49 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:00:49 user nova-compute[75260]:   <serial>0d2339ea-d938-4c2a-a425-1376f5300388</serial>
Nov 27 05:00:49 user nova-compute[75260]: </disk>
Nov 27 05:00:49 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 05:00:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:00:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:00:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No VIF found with MAC fa:16:3e:12:c4:7b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:00:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f740bf66-7a5a-412c-8fbe-0c56c548326f tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.934s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:00:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:00:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:00:52 user nova-compute[75260]: INFO nova.compute.manager [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Detaching volume 0d2339ea-d938-4c2a-a425-1376f5300388
Nov 27 05:00:53 user nova-compute[75260]: INFO nova.virt.block_device [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attempting to driver detach volume 0d2339ea-d938-4c2a-a425-1376f5300388 from mountpoint /dev/vdb
Nov 27 05:00:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Attempting to detach device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 05:00:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:00:53 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:00:53 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 05:00:53 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:00:53 user nova-compute[75260]:   <serial>0d2339ea-d938-4c2a-a425-1376f5300388</serial>
Nov 27 05:00:53 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 05:00:53 user nova-compute[75260]: </disk>
Nov 27 05:00:53 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:00:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Successfully detached device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the persistent domain config.
Nov 27 05:00:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 05:00:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:00:53 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:00:53 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 05:00:53 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:00:53 user nova-compute[75260]:   <serial>0d2339ea-d938-4c2a-a425-1376f5300388</serial>
Nov 27 05:00:53 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 05:00:53 user nova-compute[75260]: </disk>
Nov 27 05:00:53 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:00:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 05:00:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:00:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:00:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:00:57 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:00:58 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updating instance_info_cache with network_info: [{"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:00:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:00:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:00:58 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:58 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:58 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:58 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:58 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:00:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:00:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:01:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:00 user nova-compute[75260]: INFO nova.compute.manager [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Detaching volume b55a2898-2097-4cfa-b0a0-b0193ce57686
Nov 27 05:01:00 user nova-compute[75260]: INFO nova.virt.block_device [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Attempting to driver detach volume b55a2898-2097-4cfa-b0a0-b0193ce57686 from mountpoint /dev/vdb
Nov 27 05:01:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Attempting to detach device vdb from instance c037e01b-1dad-48e3-9df9-187ebb3c3587 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 05:01:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:01:00 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:01:00 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:01:00 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:01:00 user nova-compute[75260]:   <serial>b55a2898-2097-4cfa-b0a0-b0193ce57686</serial>
Nov 27 05:01:00 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 05:01:00 user nova-compute[75260]: </disk>
Nov 27 05:01:00 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:01:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Successfully detached device vdb from instance c037e01b-1dad-48e3-9df9-187ebb3c3587 from the persistent domain config.
Nov 27 05:01:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c037e01b-1dad-48e3-9df9-187ebb3c3587 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 05:01:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:01:00 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:01:00 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:01:00 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:01:00 user nova-compute[75260]:   <serial>b55a2898-2097-4cfa-b0a0-b0193ce57686</serial>
Nov 27 05:01:00 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 05:01:00 user nova-compute[75260]: </disk>
Nov 27 05:01:00 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:01:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:01:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:00 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c037e01b-1dad-48e3-9df9-187ebb3c3587 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:01:01 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:02 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:03 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:01:03 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8041MB free_disk=25.167213439941406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Applying migration context for instance 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d as it has an incoming, in-progress migration 6f2a7f9c-a756-4a0b-a4e6-62e2a6cf4c50. Migration status is finished {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 05:01:03 user nova-compute[75260]: INFO nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating resource usage from migration 6f2a7f9c-a756-4a0b-a4e6-62e2a6cf4c50
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1a25081f-79d1-412f-bf99-4235516d40a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4bff94d1-4400-4dff-baff-fc10c8070b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance c037e01b-1dad-48e3-9df9-187ebb3c3587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Migration 6f2a7f9c-a756-4a0b-a4e6-62e2a6cf4c50 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 25fc2351-09a3-4d9f-83b7-485677fa8caf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:01:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:13 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 is timed out.
Nov 27 05:01:13 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Successfully detached device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the live domain config.
Nov 27 05:01:13 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMGzKZTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:01:13 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf154980-eb75-48f9-af75-09b8f603b638]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:01:13 user nova-compute[75260]: No targets found.
Nov 27 05:01:13 user nova-compute[75260]: iSNS:
Nov 27 05:01:13 user nova-compute[75260]: No targets found.
Nov 27 05:01:13 user nova-compute[75260]: STATIC:
Nov 27 05:01:13 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:01:13 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:13 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:13 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 05:01:13 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:13 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:13 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388
Nov 27 05:01:13 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:13 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:13 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69
Nov 27 05:01:13 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:13 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:13 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686
Nov 27 05:01:13 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:13 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:13 user nova-compute[75260]: FIRMWARE:
Nov 27 05:01:13 user nova-compute[75260]: No targets found.
Nov 27 05:01:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:01:13 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:01:13 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d8a348-7b29-4d6e-9882-8da14332f079]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1e51b7-5e25-49a4-8407-0a98318fa921]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:01:13 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:01:13 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:01:13 user nova-compute[75260]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)
Nov 27 05:01:13 user nova-compute[75260]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 (non-flash)
Nov 27 05:01:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:01:13 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:01:13 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:01:13 user nova-compute[75260]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)
Nov 27 05:01:13 user nova-compute[75260]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 (non-flash)
Nov 27 05:01:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54257130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388'): ({'sde'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Removing single pathed devices sde {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[64990896-a8ba-454a-a4f7-8e726bdb4a80]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.056s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b19c50b-0ca3-47eb-a5ce-7b49bdaff50e]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Flushing IO for device /dev/sde {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[43afbd56-d978-4bd1-b221-946262c32bf5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.144s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8d8fa6-c826-4a1b-851c-523667bf0afc]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7270cf1-051c-4f02-be77-b57d1ac3102f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f691911-d118-439c-bc81-57e6d284996c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388, portal: 172.16.0.220,3260]
Nov 27 05:01:13 user nova-compute[75260]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388, portal: 172.16.0.220,3260] successful.
Nov 27 05:01:13 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d2339ea-d938-4c2a-a425-1376f5300388 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbe8847-6b22-4e6c-8d18-5abaa4676bdf]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.495s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:01:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== disconnect_volume: return (497ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:01:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:01:14 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:01:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3159b0ac-9592-46df-a63f-6b191adb45a5 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.864s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:21 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c037e01b-1dad-48e3-9df9-187ebb3c3587 is timed out.
Nov 27 05:01:21 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Successfully detached device vdb from instance c037e01b-1dad-48e3-9df9-187ebb3c3587 from the live domain config.
Nov 27 05:01:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdMtWvrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:01:21 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bda39b-18ec-412a-9eca-7ee385a4d952]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:01:21 user nova-compute[75260]: No targets found.
Nov 27 05:01:21 user nova-compute[75260]: iSNS:
Nov 27 05:01:21 user nova-compute[75260]: No targets found.
Nov 27 05:01:21 user nova-compute[75260]: STATIC:
Nov 27 05:01:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:01:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 05:01:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69
Nov 27 05:01:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:21 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686
Nov 27 05:01:21 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:21 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:21 user nova-compute[75260]: FIRMWARE:
Nov 27 05:01:21 user nova-compute[75260]: No targets found.
Nov 27 05:01:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:01:21 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:01:21 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[43de351f-32cf-4788-a18c-8374f7a4364c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a766a309-2c08-4e0c-8b8d-c81994ed3b47]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:01:21 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:01:21 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:01:21 user nova-compute[75260]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)
Nov 27 05:01:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:01:21 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:01:21 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:01:21 user nova-compute[75260]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 (non-flash)
Nov 27 05:01:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb542549d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcd8f65-2ddd-4e09-a7e0-ba0f622be0d2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a068ab2-c997-4dbe-95dd-9f471d913b64]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e94745-0083-4a98-91da-864cd7260246]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae83bb3e-7f38-4e94-a1a2-d75dd64e318c]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cac083-c634-42cb-a29d-4307aa1b86be]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd977d6-8677-4dca-8539-3bad550bbf8e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686, portal: 172.16.0.220,3260]
Nov 27 05:01:21 user nova-compute[75260]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686, portal: 172.16.0.220,3260] successful.
Nov 27 05:01:21 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b623c8d-f712-4ce8-9f87-0577b2eee799]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] <== disconnect_volume: return (318ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:01:21 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG nova.objects.instance [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lazy-loading 'flavor' on Instance uuid c037e01b-1dad-48e3-9df9-187ebb3c3587 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-15320228-f9af-41aa-88ef-389673367929 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.676s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.573s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:22 user nova-compute[75260]: INFO nova.compute.manager [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Terminating instance
Nov 27 05:01:22 user nova-compute[75260]: DEBUG nova.compute.manager [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-c5ca0d51-d338-4758-9f95-3666f5ffbe35 req-f14729bd-e190-4401-8ba0-cb89e77b8a9e service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received event network-vif-unplugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c5ca0d51-d338-4758-9f95-3666f5ffbe35 req-f14729bd-e190-4401-8ba0-cb89e77b8a9e service nova] Acquiring lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c5ca0d51-d338-4758-9f95-3666f5ffbe35 req-f14729bd-e190-4401-8ba0-cb89e77b8a9e service nova] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c5ca0d51-d338-4758-9f95-3666f5ffbe35 req-f14729bd-e190-4401-8ba0-cb89e77b8a9e service nova] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-c5ca0d51-d338-4758-9f95-3666f5ffbe35 req-f14729bd-e190-4401-8ba0-cb89e77b8a9e service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] No waiting events found dispatching network-vif-unplugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-c5ca0d51-d338-4758-9f95-3666f5ffbe35 req-f14729bd-e190-4401-8ba0-cb89e77b8a9e service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received event network-vif-unplugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:22 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Instance destroyed successfully.
Nov 27 05:01:22 user nova-compute[75260]: DEBUG nova.objects.instance [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lazy-loading 'resources' on Instance uuid c037e01b-1dad-48e3-9df9-187ebb3c3587 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-27137687',display_name='tempest-VolumesSnapshotTestJSON-instance-27137687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-27137687',id=41,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsKKJr5Cry9CxF4XRL41Uvmw1KQNk0ACa/j/cBZDmhdRGMkMSvcOdZG/G7WYzXqtSAU4YuTo8eOH30pPHbEmN5+z25VjJ34GIyLhNpWYThHytkfParMwgQM0+JBdFdl9g==',key_name='tempest-keypair-1574529496',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:58:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bff13437be5d4e46ab6ebe91272f08e4',ramdisk_id='',reservation_id='r-iimgk304',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1878477578',owner_user_name='tempest-VolumesSnapshotTestJSON-1878477578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21ac605bebd04b48ac35eb2ad41e4e00',uuid=c037e01b-1dad-48e3-9df9-187ebb3c3587,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converting VIF {"id": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "address": "fa:16:3e:ab:09:64", "network": {"id": "41be7256-796d-41c4-892a-f3c94c9d445a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-377011416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bff13437be5d4e46ab6ebe91272f08e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c46d-0c", "ovs_interfaceid": "be36c46d-0c0b-4055-a9d5-bc9e3908e7bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:09:64,bridge_name='br-int',has_traffic_filtering=True,id=be36c46d-0c0b-4055-a9d5-bc9e3908e7bf,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c46d-0c') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG os_vif [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:09:64,bridge_name='br-int',has_traffic_filtering=True,id=be36c46d-0c0b-4055-a9d5-bc9e3908e7bf,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c46d-0c') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe36c46d-0c, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9fa1409-57dd-4b06-8a52-d19c8e48baec) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:01:22 user nova-compute[75260]: INFO os_vif [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:09:64,bridge_name='br-int',has_traffic_filtering=True,id=be36c46d-0c0b-4055-a9d5-bc9e3908e7bf,network=Network(41be7256-796d-41c4-892a-f3c94c9d445a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c46d-0c')
Nov 27 05:01:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdMtWvrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:01:22 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:01:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefe9e06-8e11-45df-9430-241f7e469b52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:01:22 user nova-compute[75260]: No targets found.
Nov 27 05:01:22 user nova-compute[75260]: iSNS:
Nov 27 05:01:22 user nova-compute[75260]: No targets found.
Nov 27 05:01:22 user nova-compute[75260]: STATIC:
Nov 27 05:01:22 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:01:22 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:22 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:22 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 05:01:22 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:22 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:22 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69
Nov 27 05:01:22 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:01:22 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:01:22 user nova-compute[75260]: FIRMWARE:
Nov 27 05:01:22 user nova-compute[75260]: No targets found.
Nov 27 05:01:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:01:22 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:01:22 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55a2898-2097-4cfa-b0a0-b0193ce57686', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:01:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[523e0df9-9f5d-4de3-a5f2-0009a4a826fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c176f63a-6daa-48e9-993f-242177284822]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:01:23 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:01:23 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:01:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:01:23 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:01:23 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:01:23 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb7417ec20>, {}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Disconnecting from: [] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] <== disconnect_volume: return (70ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:01:23 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Deleting instance files /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587_del
Nov 27 05:01:23 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Deletion of /opt/stack/data/nova/instances/c037e01b-1dad-48e3-9df9-187ebb3c3587_del complete
Nov 27 05:01:23 user nova-compute[75260]: INFO nova.compute.manager [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 27 05:01:23 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:01:23 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:01:23 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Took 0.76 seconds to deallocate network for instance.
Nov 27 05:01:23 user nova-compute[75260]: WARNING nova.volume.cinder [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Attachment 75b08b05-b593-4619-bcdc-62438ab30f32 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 75b08b05-b593-4619-bcdc-62438ab30f32. (HTTP 404) (Request-ID: req-07568363-c371-4d9c-9f2f-9c3b78a1790f)
Nov 27 05:01:23 user nova-compute[75260]: INFO nova.compute.manager [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Took 0.03 seconds to detach 1 volumes for instance.
Nov 27 05:01:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:24 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:01:24 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:01:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:24 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Deleted allocations for instance c037e01b-1dad-48e3-9df9-187ebb3c3587
Nov 27 05:01:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-8cf8a2e6-3438-48e9-93d7-654fe6b5dc29 req-5a54898a-eab5-4119-97ac-3675b4aaeb42 service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received event network-vif-plugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:01:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8cf8a2e6-3438-48e9-93d7-654fe6b5dc29 req-5a54898a-eab5-4119-97ac-3675b4aaeb42 service nova] Acquiring lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8cf8a2e6-3438-48e9-93d7-654fe6b5dc29 req-5a54898a-eab5-4119-97ac-3675b4aaeb42 service nova] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8cf8a2e6-3438-48e9-93d7-654fe6b5dc29 req-5a54898a-eab5-4119-97ac-3675b4aaeb42 service nova] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-8cf8a2e6-3438-48e9-93d7-654fe6b5dc29 req-5a54898a-eab5-4119-97ac-3675b4aaeb42 service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] No waiting events found dispatching network-vif-plugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:01:24 user nova-compute[75260]: WARNING nova.compute.manager [req-8cf8a2e6-3438-48e9-93d7-654fe6b5dc29 req-5a54898a-eab5-4119-97ac-3675b4aaeb42 service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received unexpected event network-vif-plugged-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf for instance with vm_state deleted and task_state None.
Nov 27 05:01:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-8cf8a2e6-3438-48e9-93d7-654fe6b5dc29 req-5a54898a-eab5-4119-97ac-3675b4aaeb42 service nova] [instance: c037e01b-1dad-48e3-9df9-187ebb3c3587] Received event network-vif-deleted-be36c46d-0c0b-4055-a9d5-bc9e3908e7bf {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:01:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-796f83f4-1c57-4254-a610-ef88e22d4076 tempest-VolumesSnapshotTestJSON-1878477578 tempest-VolumesSnapshotTestJSON-1878477578-project-member] Lock "c037e01b-1dad-48e3-9df9-187ebb3c3587" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.407s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:01:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:01:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:01:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:01:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Going to confirm migration 2 {{(pid=75260) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquired lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'info_cache' on Instance uuid 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating instance_info_cache with network_info: [{"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Releasing lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'migration_context' on Instance uuid 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG nova.objects.base [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Object Instance<37cf41f0-c27b-4e5c-bc20-1b7d79daac1d> lazy-loaded attributes: info_cache,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:01:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.309s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:37 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Deleted allocation for migration 6f2a7f9c-a756-4a0b-a4e6-62e2a6cf4c50
Nov 27 05:01:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f2afc2d1-1037-482b-bd47-2e39a24527c5 tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.283s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:44 user nova-compute[75260]: DEBUG nova.objects.instance [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:01:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:45 user nova-compute[75260]: INFO nova.compute.manager [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attaching volume 26faf2ef-d289-4148-bd4d-ce1246c14fb7 to /dev/vdb
Nov 27 05:01:45 user nova-compute[75260]: DEBUG os_brick.utils [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[821906b3-d5fa-4326-a1e4-7c20e54547f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aa8f17-65a0-45cc-861b-839effb3e2d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb070eb-55a5-47c7-812b-d95419ca7f65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4f93df-ec1f-4353-81b9-216a0fadc115]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:01:45 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:01:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec37e36c-e4cc-4769-bc5a-836045c9ba19]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG os_brick.utils [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:01:45 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updating existing volume attachment record: 591f03db-835c-483e-8cc4-4b2270f69422 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:01:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTihvjyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:01:51 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:01:51 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:01:51 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c06343-4d84-4d73-8746-48820d58beb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:01:51 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76a3279-0bd4-4108-bb3a-cc0dbe873613]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7] added
Nov 27 05:01:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a18df-9721-4763-868b-0d469b693e69]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d706e99b-3aaa-45ec-835d-c9c0248242ec]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTihvjyg {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTihvjyg" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[935dbfc4-e35c-4f23-889b-983f55bfbf9a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTihvjyg'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0493826-2213-4c2b-85b7-15ff3b66b331]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[190fd86d-0de0-4c52-8ed1-ee749d2de5a1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:01:51 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:01:51 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:01:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:01:51 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:01:51 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:01:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ef21ce-5268-4e6c-821c-d96016f0d025]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7, portal: 172.16.0.220,3260]
Nov 27 05:01:51 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7, portal: 172.16.0.220,3260] successful.
Nov 27 05:01:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ae5bf4-67ff-4caa-ab22-f5e6d9ec9c89]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f9b080-7d6f-4b3a-be1d-526bdf6b4bb9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:01:51 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:01:51 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:01:51 user nova-compute[75260]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)
Nov 27 05:01:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:01:51 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:01:51 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:01:51 user nova-compute[75260]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)
Nov 27 05:01:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c2c45-4bd5-4dc6-bcd3-33dd89a46509]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:01:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTihvjyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23831656262653334', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831656262653334', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG nova.objects.instance [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 05:01:52 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:01:52 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:01:52 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:01:52 user nova-compute[75260]:   <serial>26faf2ef-d289-4148-bd4d-ce1246c14fb7</serial>
Nov 27 05:01:52 user nova-compute[75260]: </disk>
Nov 27 05:01:52 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No VIF found with MAC fa:16:3e:12:c4:7b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:01:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-39df8fa2-805d-43ec-897f-576a5c26fd17 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.014s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:01:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:01:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:01:55 user nova-compute[75260]: INFO nova.compute.manager [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Detaching volume 26faf2ef-d289-4148-bd4d-ce1246c14fb7
Nov 27 05:01:55 user nova-compute[75260]: INFO nova.virt.block_device [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attempting to driver detach volume 26faf2ef-d289-4148-bd4d-ce1246c14fb7 from mountpoint /dev/vdb
Nov 27 05:01:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Attempting to detach device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 05:01:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:01:55 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:01:55 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:01:55 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:01:55 user nova-compute[75260]:   <serial>26faf2ef-d289-4148-bd4d-ce1246c14fb7</serial>
Nov 27 05:01:55 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 05:01:55 user nova-compute[75260]: </disk>
Nov 27 05:01:55 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:01:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Successfully detached device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the persistent domain config.
Nov 27 05:01:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 05:01:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:01:55 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:01:55 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:01:55 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:01:55 user nova-compute[75260]:   <serial>26faf2ef-d289-4148-bd4d-ce1246c14fb7</serial>
Nov 27 05:01:55 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 05:01:55 user nova-compute[75260]: </disk>
Nov 27 05:01:55 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:01:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 05:01:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:01:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:01:55 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:01:56 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:01:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:01:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-1a25081f-79d1-412f-bf99-4235516d40a6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:01:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-1a25081f-79d1-412f-bf99-4235516d40a6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:01:56 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:01:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:57 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Updating instance_info_cache with network_info: [{"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:01:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-1a25081f-79d1-412f-bf99-4235516d40a6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:01:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:01:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:01:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:01:58 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:01:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:01:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:01:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:00 user nova-compute[75260]: INFO nova.compute.manager [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Unshelving
Nov 27 05:02:00 user nova-compute[75260]: INFO nova.virt.block_device [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Booting with volume 4e67cdb0-e77b-4a92-b2fc-a44eca67d54e at /dev/vda
Nov 27 05:02:00 user nova-compute[75260]: DEBUG os_brick.utils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4db18d-a076-4884-98d1-21fe4edcf714]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc2aae9-610d-4c70-823b-3af5479b76e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78dacc8-d23f-4d31-8177-7005ecca3fa5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae8e0de-b883-4ab3-aaa1-8abe32267b50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:02:00 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:02:00 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f836fc04-eb74-4788-8bc7-1d87d393643e]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG os_brick.utils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:02:00 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating existing volume attachment record: 20950d0a-b5fe-447a-9c5a-f56733d6b9e6 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:02:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:02:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:02 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:02:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:02:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:04 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:02:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:04 user nova-compute[75260]: INFO nova.compute.manager [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Rescuing
Nov 27 05:02:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:02:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquired lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:02:04 user nova-compute[75260]: DEBUG nova.network.neutron [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:02:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:05 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:02:05 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8230MB free_disk=25.185516357421875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1a25081f-79d1-412f-bf99-4235516d40a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4bff94d1-4400-4dff-baff-fc10c8070b05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 25fc2351-09a3-4d9f-83b7-485677fa8caf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4f619b72-fa16-4ae8-8693-00b8d2fa5910 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.network.neutron [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Updating instance_info_cache with network_info: [{"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Releasing lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.manager [req-b1269cb5-8a58-4900-9cb3-962aafc447e8 req-8a645e87-c2b7-4a83-92fa-caaf57823782 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-unplugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b1269cb5-8a58-4900-9cb3-962aafc447e8 req-8a645e87-c2b7-4a83-92fa-caaf57823782 service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b1269cb5-8a58-4900-9cb3-962aafc447e8 req-8a645e87-c2b7-4a83-92fa-caaf57823782 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b1269cb5-8a58-4900-9cb3-962aafc447e8 req-8a645e87-c2b7-4a83-92fa-caaf57823782 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG nova.compute.manager [req-b1269cb5-8a58-4900-9cb3-962aafc447e8 req-8a645e87-c2b7-4a83-92fa-caaf57823782 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-unplugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:02:05 user nova-compute[75260]: WARNING nova.compute.manager [req-b1269cb5-8a58-4900-9cb3-962aafc447e8 req-8a645e87-c2b7-4a83-92fa-caaf57823782 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-unplugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state active and task_state rescuing.
Nov 27 05:02:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:06 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Instance destroyed successfully.
Nov 27 05:02:06 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Attempting a stable device rescue
Nov 27 05:02:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75260) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 05:02:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Instance directory exists: not creating {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 05:02:06 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Creating image(s)
Nov 27 05:02:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "/opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "/opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "/opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:06 user nova-compute[75260]: DEBUG nova.objects.instance [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25fc2351-09a3-4d9f-83b7-485677fa8caf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "e4f4008ab756d8d1bc2437b654d4d18958b04f59" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e4f4008ab756d8d1bc2437b654d4d18958b04f59" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59.part --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG nova.virt.images [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] 2b9b2a4e-5547-45dc-9952-ecc4c2d92074 was qcow2, converting to raw {{(pid=75260) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59.part /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59.converted {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG nova.objects.instance [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lazy-loading 'pci_requests' on Instance uuid 4f619b72-fa16-4ae8-8693-00b8d2fa5910 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG nova.objects.instance [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f619b72-fa16-4ae8-8693-00b8d2fa5910 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:02:07 user nova-compute[75260]: INFO nova.compute.claims [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Claim successful on node user
Nov 27 05:02:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-891c1ab2-9a8b-43d9-a2d4-434a22bc1842 req-d0264fd2-88a0-46c8-ae62-404d20fd875b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-891c1ab2-9a8b-43d9-a2d4-434a22bc1842 req-d0264fd2-88a0-46c8-ae62-404d20fd875b service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-891c1ab2-9a8b-43d9-a2d4-434a22bc1842 req-d0264fd2-88a0-46c8-ae62-404d20fd875b service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-891c1ab2-9a8b-43d9-a2d4-434a22bc1842 req-d0264fd2-88a0-46c8-ae62-404d20fd875b service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-891c1ab2-9a8b-43d9-a2d4-434a22bc1842 req-d0264fd2-88a0-46c8-ae62-404d20fd875b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:02:07 user nova-compute[75260]: WARNING nova.compute.manager [req-891c1ab2-9a8b-43d9-a2d4-434a22bc1842 req-d0264fd2-88a0-46c8-ae62-404d20fd875b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state active and task_state rescuing.
Nov 27 05:02:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59.part /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59.converted" returned: 0 in 0.581s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59.converted --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:08 user nova-compute[75260]: INFO nova.network.neutron [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating port 98eae3b9-3a88-4152-a0f4-feef155827e0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e4f4008ab756d8d1bc2437b654d4d18958b04f59" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.085s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "e4f4008ab756d8d1bc2437b654d4d18958b04f59" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e4f4008ab756d8d1bc2437b654d4d18958b04f59" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59 --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59,backing_fmt=raw /opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/disk.rescue {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59,backing_fmt=raw /opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/disk.rescue" returned: 0 in 0.057s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e4f4008ab756d8d1bc2437b654d4d18958b04f59" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'migration_context' on Instance uuid 25fc2351-09a3-4d9f-83b7-485677fa8caf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.objects.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Object Instance<25fc2351-09a3-4d9f-83b7-485677fa8caf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Start _get_guest_xml network_info=[{"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "vif_mac": "fa:16:3e:ee:ca:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2b9b2a4e-5547-45dc-9952-ecc4c2d92074', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'e9922db9-3da1-4333-a4fb-bb9f8358971d', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqnuVtHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '25fc2351-09a3-4d9f-83b7-485677fa8caf', 'attached_at': '', 'detached_at': '', 'volume_id': 'a94b53a7-5ce0-4595-a1d2-343ab4232e69', 'serial': 'a94b53a7-5ce0-4595-a1d2-343ab4232e69'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'resources' on Instance uuid 25fc2351-09a3-4d9f-83b7-485677fa8caf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.objects.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Object Instance<25fc2351-09a3-4d9f-83b7-485677fa8caf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'numa_topology' on Instance uuid 25fc2351-09a3-4d9f-83b7-485677fa8caf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.objects.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Object Instance<25fc2351-09a3-4d9f-83b7-485677fa8caf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:02:08 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:02:08 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25fc2351-09a3-4d9f-83b7-485677fa8caf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.objects.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Object Instance<25fc2351-09a3-4d9f-83b7-485677fa8caf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqnuVtHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:02:08 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:02:08 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:02:08 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c559e8-0d11-40cf-96d3-6010def0ac5b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hqnuVtHD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 27 05:02:08 user nova-compute[75260]: node.name = iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69
Nov 27 05:02:08 user nova-compute[75260]: node.tpgt = -1
Nov 27 05:02:08 user nova-compute[75260]: node.startup = automatic
Nov 27 05:02:08 user nova-compute[75260]: node.leading_login = No
Nov 27 05:02:08 user nova-compute[75260]: iface.iscsi_ifacename = default
Nov 27 05:02:08 user nova-compute[75260]: iface.net_ifacename = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.ipaddress = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.prefix_len = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.hwaddress = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.transport_name = tcp
Nov 27 05:02:08 user nova-compute[75260]: iface.initiatorname = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.state = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.vlan_id = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.vlan_priority = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.vlan_state = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.iface_num = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.mtu = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.port = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.bootproto = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.subnet_mask = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.gateway = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.dhcp_alt_client_id_state = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.dhcp_alt_client_id = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.dhcp_dns = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.dhcp_learn_iqn = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.dhcp_req_vendor_id_state = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.dhcp_vendor_id_state = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.dhcp_vendor_id = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.dhcp_slp_da = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.fragmentation = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.gratuitous_arp = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.incoming_forwarding = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.tos_state = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.tos = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.ttl = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.delayed_ack = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.tcp_nagle = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.tcp_wsf_state = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.tcp_wsf = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.tcp_timer_scale = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.tcp_timestamp = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.redirect = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.def_task_mgmt_timeout = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.header_digest = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.data_digest = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.immediate_data = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.initial_r2t = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.data_seq_inorder = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.data_pdu_inorder = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.erl = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.max_receive_data_len = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.first_burst_len = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.max_outstanding_r2t = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.max_burst_len = 0
Nov 27 05:02:08 user nova-compute[75260]: iface.chap_auth = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.bidi_chap = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.strict_login_compliance = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.discovery_auth = <empty>
Nov 27 05:02:08 user nova-compute[75260]: iface.discovery_logout = <empty>
Nov 27 05:02:08 user nova-compute[75260]: node.discovery_address = <empty>
Nov 27 05:02:08 user nova-compute[75260]: node.discovery_port = 0
Nov 27 05:02:08 user nova-compute[75260]: node.discovery_type = static
Nov 27 05:02:08 user nova-compute[75260]: node.session.initial_cmdsn = 0
Nov 27 05:02:08 user nova-compute[75260]: node.session.initial_login_retry_max = 8
Nov 27 05:02:08 user nova-compute[75260]: node.session.xmit_thread_priority = -20
Nov 27 05:02:08 user nova-compute[75260]: node.session.cmds_max = 128
Nov 27 05:02:08 user nova-compute[75260]: node.session.queue_depth = 32
Nov 27 05:02:08 user nova-compute[75260]: node.session.nr_sessions = 1
Nov 27 05:02:08 user nova-compute[75260]: node.session.auth.authmethod = CHAP
Nov 27 05:02:08 user nova-compute[75260]: node.session.auth.username = hqnuVtHD
Nov 27 05:02:08 user nova-compute[75260]: node.session.auth.password = ***
Nov 27 05:02:08 user nova-compute[75260]: node.session.auth.username_in = <empty>
Nov 27 05:02:08 user nova-compute[75260]: node.session.auth.password_in = <empty>
Nov 27 05:02:08 user nova-compute[75260]: node.session.auth.chap_algs = MD5
Nov 27 05:02:08 user nova-compute[75260]: node.session.timeo.replacement_timeout = 120
Nov 27 05:02:08 user nova-compute[75260]: node.session.err_timeo.abort_timeout = 15
Nov 27 05:02:08 user nova-compute[75260]: node.session.err_timeo.lu_reset_timeout = 30
Nov 27 05:02:08 user nova-compute[75260]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 27 05:02:08 user nova-compute[75260]: node.session.err_timeo.host_reset_timeout = 60
Nov 27 05:02:08 user nova-compute[75260]: node.session.iscsi.FastAbort = Yes
Nov 27 05:02:08 user nova-compute[75260]: node.session.iscsi.InitialR2T = No
Nov 27 05:02:08 user nova-compute[75260]: node.session.iscsi.ImmediateData = Yes
Nov 27 05:02:08 user nova-compute[75260]: node.session.iscsi.FirstBurstLength = 262144
Nov 27 05:02:08 user nova-compute[75260]: node.session.iscsi.MaxBurstLength = 16776192
Nov 27 05:02:08 user nova-compute[75260]: node.session.iscsi.DefaultTime2Retain = 0
Nov 27 05:02:08 user nova-compute[75260]: node.session.iscsi.DefaultTime2Wait = 2
Nov 27 05:02:08 user nova-compute[75260]: node.session.iscsi.MaxConnections = 1
Nov 27 05:02:08 user nova-compute[75260]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 27 05:02:08 user nova-compute[75260]: node.session.iscsi.ERL = 0
Nov 27 05:02:08 user nova-compute[75260]: node.session.scan = manual
Nov 27 05:02:08 user nova-compute[75260]: node.session.reopen_max = 0
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].address = 172.16.0.220
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].port = 3260
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].startup = manual
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].tcp.window_size = 524288
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].tcp.type_of_service = 0
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].timeo.logout_timeout = 15
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].timeo.login_timeout = 15
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].timeo.auth_timeout = 45
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].timeo.noop_out_interval = 5
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].timeo.noop_out_timeout = 5
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].iscsi.HeaderDigest = None
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].iscsi.DataDigest = None
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].iscsi.IFMarker = No
Nov 27 05:02:08 user nova-compute[75260]: node.conn[0].iscsi.OFMarker = No
Nov 27 05:02:08 user nova-compute[75260]: # END RECORD
Nov 27 05:02:08 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31580b3-59f4-41e1-a439-5c694dee2669]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a336a7-49ce-41aa-bbc6-33641d3a59df]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hqnuVtHD {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hqnuVtHD" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed64c337-d62b-4260-91d7-8f0ba8e9b23d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hqnuVtHD'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3640f70a-3ce7-45d7-b505-bf9df4447299]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cecdf9e-685d-44b6-8638-f4bfbaaf778c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:08 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:08 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:08 user nova-compute[75260]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)
Nov 27 05:02:08 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:08 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:08 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:08 user nova-compute[75260]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)
Nov 27 05:02:08 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] HCTL ('33', '0', '0', 0) found on session 47 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquired lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fd5c09-8271-4017-a710-c2aff86a0881]: (4, ('0 0 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Searching for a device in session 47 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqnuVtHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '23936633964356332', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936633964356332', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-473047943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-473047943',id=42,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:00:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-buyu0ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:00:33Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=25fc2351-09a3-4d9f-83b7-485677fa8caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "vif_mac": "fa:16:3e:ee:ca:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "vif_mac": "fa:16:3e:ee:ca:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:ca:01,bridge_name='br-int',has_traffic_filtering=True,id=fbf4036b-0b1f-43b1-8bb0-a612d17b6eed,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf4036b-0b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'pci_devices' on Instance uuid 25fc2351-09a3-4d9f-83b7-485677fa8caf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.objects.base [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Object Instance<25fc2351-09a3-4d9f-83b7-485677fa8caf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:02:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:02:08 user nova-compute[75260]:   <uuid>25fc2351-09a3-4d9f-83b7-485677fa8caf</uuid>
Nov 27 05:02:08 user nova-compute[75260]:   <name>instance-0000002a</name>
Nov 27 05:02:08 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:02:08 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:02:08 user nova-compute[75260]:   <metadata>
Nov 27 05:02:08 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:02:08 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:02:08 user nova-compute[75260]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-473047943</nova:name>
Nov 27 05:02:08 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:02:08</nova:creationTime>
Nov 27 05:02:08 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:02:08 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:02:08 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:02:08 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:02:08 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:02:08 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:02:08 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:02:08 user nova-compute[75260]:       <nova:owner>
Nov 27 05:02:08 user nova-compute[75260]:         <nova:user uuid="05cdf3b00bfe4f728e7fa4e17eba3c4e">tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member</nova:user>
Nov 27 05:02:08 user nova-compute[75260]:         <nova:project uuid="7eada319615449deb2152f59ba3d3e6d">tempest-ServerBootFromVolumeStableRescueTest-293744143</nova:project>
Nov 27 05:02:08 user nova-compute[75260]:       </nova:owner>
Nov 27 05:02:08 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 05:02:08 user nova-compute[75260]:       <nova:ports>
Nov 27 05:02:08 user nova-compute[75260]:         <nova:port uuid="fbf4036b-0b1f-43b1-8bb0-a612d17b6eed">
Nov 27 05:02:08 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 05:02:08 user nova-compute[75260]:         </nova:port>
Nov 27 05:02:08 user nova-compute[75260]:       </nova:ports>
Nov 27 05:02:08 user nova-compute[75260]:     </nova:instance>
Nov 27 05:02:08 user nova-compute[75260]:   </metadata>
Nov 27 05:02:08 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:02:08 user nova-compute[75260]:     <system>
Nov 27 05:02:08 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:02:08 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:02:08 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:02:08 user nova-compute[75260]:       <entry name="serial">25fc2351-09a3-4d9f-83b7-485677fa8caf</entry>
Nov 27 05:02:08 user nova-compute[75260]:       <entry name="uuid">25fc2351-09a3-4d9f-83b7-485677fa8caf</entry>
Nov 27 05:02:08 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:02:08 user nova-compute[75260]:     </system>
Nov 27 05:02:08 user nova-compute[75260]:   </sysinfo>
Nov 27 05:02:08 user nova-compute[75260]:   <os>
Nov 27 05:02:08 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:02:08 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:02:08 user nova-compute[75260]:   </os>
Nov 27 05:02:08 user nova-compute[75260]:   <features>
Nov 27 05:02:08 user nova-compute[75260]:     <acpi/>
Nov 27 05:02:08 user nova-compute[75260]:     <apic/>
Nov 27 05:02:08 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:02:08 user nova-compute[75260]:   </features>
Nov 27 05:02:08 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:02:08 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:02:08 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:02:08 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:02:08 user nova-compute[75260]:   </clock>
Nov 27 05:02:08 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:02:08 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:02:08 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:02:08 user nova-compute[75260]:   </cpu>
Nov 27 05:02:08 user nova-compute[75260]:   <devices>
Nov 27 05:02:08 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:02:08 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:02:08 user nova-compute[75260]:       <source dev="/dev/sdb"/>
Nov 27 05:02:08 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:02:08 user nova-compute[75260]:       <serial>a94b53a7-5ce0-4595-a1d2-343ab4232e69</serial>
Nov 27 05:02:08 user nova-compute[75260]:     </disk>
Nov 27 05:02:08 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 05:02:08 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 05:02:08 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/disk.rescue"/>
Nov 27 05:02:08 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 05:02:08 user nova-compute[75260]:       <boot order="1"/>
Nov 27 05:02:08 user nova-compute[75260]:     </disk>
Nov 27 05:02:08 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:02:08 user nova-compute[75260]:       <mac address="fa:16:3e:ee:ca:01"/>
Nov 27 05:02:08 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:02:08 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:02:08 user nova-compute[75260]:       <target dev="tapfbf4036b-0b"/>
Nov 27 05:02:08 user nova-compute[75260]:     </interface>
Nov 27 05:02:08 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:02:08 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/console.log" append="off"/>
Nov 27 05:02:08 user nova-compute[75260]:     </serial>
Nov 27 05:02:08 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:02:08 user nova-compute[75260]:     <video>
Nov 27 05:02:08 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:02:08 user nova-compute[75260]:     </video>
Nov 27 05:02:08 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:02:08 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:02:08 user nova-compute[75260]:     </rng>
Nov 27 05:02:08 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:02:08 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:02:08 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:02:08 user nova-compute[75260]:     </memballoon>
Nov 27 05:02:08 user nova-compute[75260]:   </devices>
Nov 27 05:02:08 user nova-compute[75260]: </domain>
Nov 27 05:02:08 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:02:08 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Instance destroyed successfully.
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] No VIF found with MAC fa:16:3e:ee:ca:01, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.network.neutron [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating instance_info_cache with network_info: [{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Releasing lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:02:09 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Creating image(s)
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Ensure instance console log exists: /opt/stack/data/nova/instances/4f619b72-fa16-4ae8-8693-00b8d2fa5910/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Start _get_guest_xml network_info=[{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '20950d0a-b5fe-447a-9c5a-f56733d6b9e6', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASLuoGVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f619b72-fa16-4ae8-8693-00b8d2fa5910', 'attached_at': '', 'detached_at': '', 'volume_id': '4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 'serial': '4e67cdb0-e77b-4a92-b2fc-a44eca67d54e'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:02:09 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:02:09 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.objects.instance [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f619b72-fa16-4ae8-8693-00b8d2fa5910 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.objects.base [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Object Instance<4f619b72-fa16-4ae8-8693-00b8d2fa5910> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASLuoGVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:02:09 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:02:09 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:02:09 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[18683107-356a-4e16-971e-40baf732a4f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:02:09 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee57128-365d-4228-ac4d-fac3bd60ef00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e] added
Nov 27 05:02:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdac0fa-6976-4113-80c0-3d202a096c28]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bd68b2-9e8f-4c08-8371-ff29c29485fa]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASLuoGVZ {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASLuoGVZ" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4572586e-a6f9-42c6-b686-ae8d48fafeac]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASLuoGVZ'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb86b63-a500-49c8-8074-1a15b8dfb72f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7133f4e-c8b3-463c-8575-3beb06d87594]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)
Nov 27 05:02:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)
Nov 27 05:02:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfbb0f0-00da-4f34-9405-3f74cbc1a606]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260]
Nov 27 05:02:09 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260] successful.
Nov 27 05:02:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[505b368f-0417-41d6-95f8-dca189c632af]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef6e025-081f-4d6f-8de0-d5442cc425ec]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:02:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)
Nov 27 05:02:09 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:02:09 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[679162b6-e739-453d-a464-d2ba5b8bfe49]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: None {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-08692c48-8703-4b4a-ac40-19f8011675ec req-48e11dd9-4dda-47b8-bd4e-a23ffde83d55 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-changed-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-08692c48-8703-4b4a-ac40-19f8011675ec req-48e11dd9-4dda-47b8-bd4e-a23ffde83d55 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Refreshing instance network info cache due to event network-changed-98eae3b9-3a88-4152-a0f4-feef155827e0. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-08692c48-8703-4b4a-ac40-19f8011675ec req-48e11dd9-4dda-47b8-bd4e-a23ffde83d55 service nova] Acquiring lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-08692c48-8703-4b4a-ac40-19f8011675ec req-48e11dd9-4dda-47b8-bd4e-a23ffde83d55 service nova] Acquired lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:02:09 user nova-compute[75260]: DEBUG nova.network.neutron [req-08692c48-8703-4b4a-ac40-19f8011675ec req-48e11dd9-4dda-47b8-bd4e-a23ffde83d55 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Refreshing network info cache for port 98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.network.neutron [req-08692c48-8703-4b4a-ac40-19f8011675ec req-48e11dd9-4dda-47b8-bd4e-a23ffde83d55 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updated VIF entry in instance network info cache for port 98eae3b9-3a88-4152-a0f4-feef155827e0. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.network.neutron [req-08692c48-8703-4b4a-ac40-19f8011675ec req-48e11dd9-4dda-47b8-bd4e-a23ffde83d55 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating instance_info_cache with network_info: [{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-08692c48-8703-4b4a-ac40-19f8011675ec req-48e11dd9-4dda-47b8-bd4e-a23ffde83d55 service nova] Releasing lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASLuoGVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23431383136633538', 'path': '/dev/sde'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431383136633538', 'path': '/dev/sde'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T04:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1751229513',display_name='tempest-TestShelveInstance-server-1751229513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1751229513',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-141016732',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:58:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6bdd9716601a4207b876ddcffff6458c',ramdisk_id='',reservation_id='r-ilmv1pst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1324535314',owner_user_name='tempest-TestShelveInstance-1324535314-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:02:00Z,user_data=None,user_id='2e48682a815e4ec38876b91a70718ed2',uuid=4f619b72-fa16-4ae8-8693-00b8d2fa5910,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converting VIF {"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.objects.instance [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f619b72-fa16-4ae8-8693-00b8d2fa5910 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.objects.base [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Object Instance<4f619b72-fa16-4ae8-8693-00b8d2fa5910> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:02:10 user nova-compute[75260]:   <uuid>4f619b72-fa16-4ae8-8693-00b8d2fa5910</uuid>
Nov 27 05:02:10 user nova-compute[75260]:   <name>instance-00000028</name>
Nov 27 05:02:10 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:02:10 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:02:10 user nova-compute[75260]:   <metadata>
Nov 27 05:02:10 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:02:10 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:02:10 user nova-compute[75260]:       <nova:name>tempest-TestShelveInstance-server-1751229513</nova:name>
Nov 27 05:02:10 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:02:09</nova:creationTime>
Nov 27 05:02:10 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:02:10 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:02:10 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:02:10 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:02:10 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:02:10 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:02:10 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:02:10 user nova-compute[75260]:       <nova:owner>
Nov 27 05:02:10 user nova-compute[75260]:         <nova:user uuid="2e48682a815e4ec38876b91a70718ed2">tempest-TestShelveInstance-1324535314-project-member</nova:user>
Nov 27 05:02:10 user nova-compute[75260]:         <nova:project uuid="6bdd9716601a4207b876ddcffff6458c">tempest-TestShelveInstance-1324535314</nova:project>
Nov 27 05:02:10 user nova-compute[75260]:       </nova:owner>
Nov 27 05:02:10 user nova-compute[75260]:       <nova:ports>
Nov 27 05:02:10 user nova-compute[75260]:         <nova:port uuid="98eae3b9-3a88-4152-a0f4-feef155827e0">
Nov 27 05:02:10 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 05:02:10 user nova-compute[75260]:         </nova:port>
Nov 27 05:02:10 user nova-compute[75260]:       </nova:ports>
Nov 27 05:02:10 user nova-compute[75260]:     </nova:instance>
Nov 27 05:02:10 user nova-compute[75260]:   </metadata>
Nov 27 05:02:10 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:02:10 user nova-compute[75260]:     <system>
Nov 27 05:02:10 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:02:10 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:02:10 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:02:10 user nova-compute[75260]:       <entry name="serial">4f619b72-fa16-4ae8-8693-00b8d2fa5910</entry>
Nov 27 05:02:10 user nova-compute[75260]:       <entry name="uuid">4f619b72-fa16-4ae8-8693-00b8d2fa5910</entry>
Nov 27 05:02:10 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:02:10 user nova-compute[75260]:     </system>
Nov 27 05:02:10 user nova-compute[75260]:   </sysinfo>
Nov 27 05:02:10 user nova-compute[75260]:   <os>
Nov 27 05:02:10 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:02:10 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:02:10 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:02:10 user nova-compute[75260]:   </os>
Nov 27 05:02:10 user nova-compute[75260]:   <features>
Nov 27 05:02:10 user nova-compute[75260]:     <acpi/>
Nov 27 05:02:10 user nova-compute[75260]:     <apic/>
Nov 27 05:02:10 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:02:10 user nova-compute[75260]:   </features>
Nov 27 05:02:10 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:02:10 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:02:10 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:02:10 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:02:10 user nova-compute[75260]:   </clock>
Nov 27 05:02:10 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:02:10 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:02:10 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:02:10 user nova-compute[75260]:   </cpu>
Nov 27 05:02:10 user nova-compute[75260]:   <devices>
Nov 27 05:02:10 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:02:10 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:02:10 user nova-compute[75260]:       <source dev="/dev/sde"/>
Nov 27 05:02:10 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:02:10 user nova-compute[75260]:       <serial>4e67cdb0-e77b-4a92-b2fc-a44eca67d54e</serial>
Nov 27 05:02:10 user nova-compute[75260]:     </disk>
Nov 27 05:02:10 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:02:10 user nova-compute[75260]:       <mac address="fa:16:3e:fc:40:25"/>
Nov 27 05:02:10 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:02:10 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:02:10 user nova-compute[75260]:       <target dev="tap98eae3b9-3a"/>
Nov 27 05:02:10 user nova-compute[75260]:     </interface>
Nov 27 05:02:10 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:02:10 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/4f619b72-fa16-4ae8-8693-00b8d2fa5910/console.log" append="off"/>
Nov 27 05:02:10 user nova-compute[75260]:     </serial>
Nov 27 05:02:10 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:02:10 user nova-compute[75260]:     <video>
Nov 27 05:02:10 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:02:10 user nova-compute[75260]:     </video>
Nov 27 05:02:10 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:02:10 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:02:10 user nova-compute[75260]:     </rng>
Nov 27 05:02:10 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:02:10 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:02:10 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:02:10 user nova-compute[75260]:     </memballoon>
Nov 27 05:02:10 user nova-compute[75260]:   </devices>
Nov 27 05:02:10 user nova-compute[75260]: </domain>
Nov 27 05:02:10 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T04:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1751229513',display_name='tempest-TestShelveInstance-server-1751229513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1751229513',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-141016732',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:58:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6bdd9716601a4207b876ddcffff6458c',ramdisk_id='',reservation_id='r-ilmv1pst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1324535314',owner_user_name='tempest-TestShelveInstance-1324535314-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:02:00Z,user_data=None,user_id='2e48682a815e4ec38876b91a70718ed2',uuid=4f619b72-fa16-4ae8-8693-00b8d2fa5910,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converting VIF {"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG os_vif [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7e48ac4-f43e-58e1-b650-d3eed6ae9b02', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98eae3b9-3a, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98eae3b9-3a, col_values=(('qos', UUID('ebdc2f73-9dd9-4a50-a74f-af58f22cf76b')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98eae3b9-3a, col_values=(('external_ids', {'iface-id': '98eae3b9-3a88-4152-a0f4-feef155827e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:40:25', 'vm-uuid': '4f619b72-fa16-4ae8-8693-00b8d2fa5910'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:10 user nova-compute[75260]: INFO os_vif [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a')
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:02:10 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] No VIF found with MAC fa:16:3e:fc:40:25, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:02:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:02:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:02:11 user nova-compute[75260]: WARNING nova.compute.manager [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state active and task_state rescuing.
Nov 27 05:02:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:02:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:11 user nova-compute[75260]: DEBUG nova.compute.manager [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:02:11 user nova-compute[75260]: WARNING nova.compute.manager [req-3dae944b-29d2-40d7-8b5b-0d6274d2bcf0 req-5ae722c6-0db1-4ba5-b172-2fd0c4c6e0e4 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state active and task_state rescuing.
Nov 27 05:02:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-0c7d4ee6-eb85-4f53-adee-0c590180dd70 req-84b7c182-772c-443b-bc7f-68e09a6391cf service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0c7d4ee6-eb85-4f53-adee-0c590180dd70 req-84b7c182-772c-443b-bc7f-68e09a6391cf service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0c7d4ee6-eb85-4f53-adee-0c590180dd70 req-84b7c182-772c-443b-bc7f-68e09a6391cf service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-0c7d4ee6-eb85-4f53-adee-0c590180dd70 req-84b7c182-772c-443b-bc7f-68e09a6391cf service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-0c7d4ee6-eb85-4f53-adee-0c590180dd70 req-84b7c182-772c-443b-bc7f-68e09a6391cf service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:02:12 user nova-compute[75260]: WARNING nova.compute.manager [req-0c7d4ee6-eb85-4f53-adee-0c590180dd70 req-84b7c182-772c-443b-bc7f-68e09a6391cf service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received unexpected event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 05:02:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-80fe30b2-5aeb-44a6-baca-ec78945dc010 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-d5cd7042-b091-4dd4-bc89-2361b2db526d req-bce5828b-6a47-4ccc-8ee1-c9d42b83b114 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:02:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d5cd7042-b091-4dd4-bc89-2361b2db526d req-bce5828b-6a47-4ccc-8ee1-c9d42b83b114 service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d5cd7042-b091-4dd4-bc89-2361b2db526d req-bce5828b-6a47-4ccc-8ee1-c9d42b83b114 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d5cd7042-b091-4dd4-bc89-2361b2db526d req-bce5828b-6a47-4ccc-8ee1-c9d42b83b114 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-d5cd7042-b091-4dd4-bc89-2361b2db526d req-bce5828b-6a47-4ccc-8ee1-c9d42b83b114 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:02:14 user nova-compute[75260]: WARNING nova.compute.manager [req-d5cd7042-b091-4dd4-bc89-2361b2db526d req-bce5828b-6a47-4ccc-8ee1-c9d42b83b114 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received unexpected event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 05:02:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:02:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:02:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Instance spawned successfully.
Nov 27 05:02:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:02:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-bb0345f8-12c9-47f0-a78f-756da3f72b32 tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.673s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 is timed out.
Nov 27 05:02:15 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Successfully detached device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the live domain config.
Nov 27 05:02:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTihvjyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:02:15 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[77246451-414a-4823-8c61-0f91958bbf56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:02:15 user nova-compute[75260]: No targets found.
Nov 27 05:02:15 user nova-compute[75260]: iSNS:
Nov 27 05:02:15 user nova-compute[75260]: No targets found.
Nov 27 05:02:15 user nova-compute[75260]: STATIC:
Nov 27 05:02:15 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7
Nov 27 05:02:15 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:02:15 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:02:15 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:02:15 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:02:15 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:02:15 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 05:02:15 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:02:15 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:02:15 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69
Nov 27 05:02:15 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:02:15 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:02:15 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e
Nov 27 05:02:15 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:02:15 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:02:15 user nova-compute[75260]: FIRMWARE:
Nov 27 05:02:15 user nova-compute[75260]: No targets found.
Nov 27 05:02:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:02:15 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:02:15 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e4da9-565c-45a7-b130-98cf2d751d24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb0a81-56b3-4f0a-85af-62a88bf3b800]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:15 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:15 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:15 user nova-compute[75260]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)
Nov 27 05:02:15 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:02:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:15 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:15 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:15 user nova-compute[75260]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 (non-flash)
Nov 27 05:02:15 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:02:15 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb74bfa5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e291f9-e788-4778-81b7-1cee49bb52e2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.049s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a39b307-f937-4378-9031-ae15a60e6192]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ee6b50-95a2-4797-81fe-5bb12caf6a68]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8190e8a4-d42c-42fd-afeb-b4282745c0f8]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:02:15 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.051s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba797aa-d9f7-4160-8396-9d189c33b65f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00d0f7a-58d4-40cd-a56c-03df1ccaef0d]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7, portal: 172.16.0.220,3260]
Nov 27 05:02:16 user nova-compute[75260]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7, portal: 172.16.0.220,3260] successful.
Nov 27 05:02:16 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26faf2ef-d289-4148-bd4d-ce1246c14fb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b0d17a-8100-45e4-a294-8e5f6ffc0c23]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== disconnect_volume: return (433ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:02:16 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:02:17 user nova-compute[75260]: DEBUG nova.objects.instance [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30f4a244-5c29-4b50-80a3-b790245a88dc tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.889s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG nova.objects.instance [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:48 user nova-compute[75260]: INFO nova.compute.manager [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attaching volume b5bc20ce-4879-4a67-b438-a5e1b5680047 to /dev/vdb
Nov 27 05:02:48 user nova-compute[75260]: DEBUG os_brick.utils [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0265935-3743-42df-8d7b-62815dea462e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b648b8-9930-4a10-8e07-c9c841312fb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dfbc84-6ec1-4b97-87aa-abf90ee2217c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7153be72-238f-4eae-9236-d2f9f0f5e4a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:02:48 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:02:48 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee610506-2084-41d1-99b6-c73956db51ff]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG os_brick.utils [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:02:48 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updating existing volume attachment record: 6d93f187-17df-4cff-9128-81eb9b935697 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:02:50 user nova-compute[75260]: INFO nova.compute.claims [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Claim successful on node user
Nov 27 05:02:50 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG nova.network.neutron [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:02:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:02:50 user nova-compute[75260]: DEBUG nova.policy [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e509f168517f4fef82ce3d34122fd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc3728cb2564827a26f40cbc0ec6b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:02:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Creating image(s)
Nov 27 05:02:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "/opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "/opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "ccbd70b538de228b02b06aa8398c2dd3bb4f9af1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "ccbd70b538de228b02b06aa8398c2dd3bb4f9af1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1.part --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG nova.network.neutron [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Successfully created port: caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG nova.virt.images [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] 13f29525-2b44-4a8a-be17-73a7879c0207 was qcow2, converting to raw {{(pid=75260) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1.part /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1.converted {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1.part /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1.converted" returned: 0 in 0.263s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1.converted --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "ccbd70b538de228b02b06aa8398c2dd3bb4f9af1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.187s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Successfully updated port: caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquired lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1 --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "ccbd70b538de228b02b06aa8398c2dd3bb4f9af1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "ccbd70b538de228b02b06aa8398c2dd3bb4f9af1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-835d829a-2908-4b58-80e7-527e83067757 req-a8680517-d5fc-4b17-b431-8f6c18c92fca service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-changed-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-835d829a-2908-4b58-80e7-527e83067757 req-a8680517-d5fc-4b17-b431-8f6c18c92fca service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Refreshing instance network info cache due to event network-changed-caaf84bc-7039-4868-99b4-391387bd4a1e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-835d829a-2908-4b58-80e7-527e83067757 req-a8680517-d5fc-4b17-b431-8f6c18c92fca service nova] Acquiring lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1 --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1,backing_fmt=raw /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1,backing_fmt=raw /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk 1073741824" returned: 0 in 0.056s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "ccbd70b538de228b02b06aa8398c2dd3bb4f9af1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updating instance_info_cache with network_info: [{"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Releasing lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Instance network_info: |[{"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-835d829a-2908-4b58-80e7-527e83067757 req-a8680517-d5fc-4b17-b431-8f6c18c92fca service nova] Acquired lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG nova.network.neutron [req-835d829a-2908-4b58-80e7-527e83067757 req-a8680517-d5fc-4b17-b431-8f6c18c92fca service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Refreshing network info cache for port caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1 --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 05:02:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Cannot resize image /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Ensure instance console log exists: /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Start _get_guest_xml network_info=[{"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T05:02:47Z,direct_url=<?>,disk_format='qcow2',id=13f29525-2b44-4a8a-be17-73a7879c0207,min_disk=0,min_ram=0,name='tempest-scenario-img--156441558',owner='1fc3728cb2564827a26f40cbc0ec6b5f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T05:02:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '13f29525-2b44-4a8a-be17-73a7879c0207'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:02:53 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:02:53 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T05:02:47Z,direct_url=<?>,disk_format='qcow2',id=13f29525-2b44-4a8a-be17-73a7879c0207,min_disk=0,min_ram=0,name='tempest-scenario-img--156441558',owner='1fc3728cb2564827a26f40cbc0ec6b5f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T05:02:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-693034548',display_name='tempest-TestMinimumBasicScenario-server-693034548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-693034548',id=43,image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU2zN3v9oVCiggBA5zHD8JmoZleg+rDjqNxhjG4l1CzZldqjmA/+FDQYVcFjRfjYVF7IVddPZ6X7/dbN3Vp3r6Rl3gM0ey358L9QSrG80I2HFLoYJV6FdEaOHxVFljKXg==',key_name='tempest-TestMinimumBasicScenario-494858082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fc3728cb2564827a26f40cbc0ec6b5f',ramdisk_id='',reservation_id='r-1pgqw0l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-372834875',owner_user_name='tempest-TestMinimumBasicScenario-372834875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:02:51Z,user_data=None,user_id='e509f168517f4fef82ce3d34122fd59d',uuid=dc56ef1d-a722-4c3d-9d24-b7233d18018c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converting VIF {"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.objects.instance [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'pci_devices' on Instance uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:02:53 user nova-compute[75260]:   <uuid>dc56ef1d-a722-4c3d-9d24-b7233d18018c</uuid>
Nov 27 05:02:53 user nova-compute[75260]:   <name>instance-0000002b</name>
Nov 27 05:02:53 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:02:53 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:02:53 user nova-compute[75260]:   <metadata>
Nov 27 05:02:53 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:02:53 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:02:53 user nova-compute[75260]:       <nova:name>tempest-TestMinimumBasicScenario-server-693034548</nova:name>
Nov 27 05:02:53 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:02:53</nova:creationTime>
Nov 27 05:02:53 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:02:53 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:02:53 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:02:53 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:02:53 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:02:53 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:02:53 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:02:53 user nova-compute[75260]:       <nova:owner>
Nov 27 05:02:53 user nova-compute[75260]:         <nova:user uuid="e509f168517f4fef82ce3d34122fd59d">tempest-TestMinimumBasicScenario-372834875-project-member</nova:user>
Nov 27 05:02:53 user nova-compute[75260]:         <nova:project uuid="1fc3728cb2564827a26f40cbc0ec6b5f">tempest-TestMinimumBasicScenario-372834875</nova:project>
Nov 27 05:02:53 user nova-compute[75260]:       </nova:owner>
Nov 27 05:02:53 user nova-compute[75260]:       <nova:root type="image" uuid="13f29525-2b44-4a8a-be17-73a7879c0207"/>
Nov 27 05:02:53 user nova-compute[75260]:       <nova:ports>
Nov 27 05:02:53 user nova-compute[75260]:         <nova:port uuid="caaf84bc-7039-4868-99b4-391387bd4a1e">
Nov 27 05:02:53 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 05:02:53 user nova-compute[75260]:         </nova:port>
Nov 27 05:02:53 user nova-compute[75260]:       </nova:ports>
Nov 27 05:02:53 user nova-compute[75260]:     </nova:instance>
Nov 27 05:02:53 user nova-compute[75260]:   </metadata>
Nov 27 05:02:53 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:02:53 user nova-compute[75260]:     <system>
Nov 27 05:02:53 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:02:53 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:02:53 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:02:53 user nova-compute[75260]:       <entry name="serial">dc56ef1d-a722-4c3d-9d24-b7233d18018c</entry>
Nov 27 05:02:53 user nova-compute[75260]:       <entry name="uuid">dc56ef1d-a722-4c3d-9d24-b7233d18018c</entry>
Nov 27 05:02:53 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:02:53 user nova-compute[75260]:     </system>
Nov 27 05:02:53 user nova-compute[75260]:   </sysinfo>
Nov 27 05:02:53 user nova-compute[75260]:   <os>
Nov 27 05:02:53 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:02:53 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:02:53 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:02:53 user nova-compute[75260]:   </os>
Nov 27 05:02:53 user nova-compute[75260]:   <features>
Nov 27 05:02:53 user nova-compute[75260]:     <acpi/>
Nov 27 05:02:53 user nova-compute[75260]:     <apic/>
Nov 27 05:02:53 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:02:53 user nova-compute[75260]:   </features>
Nov 27 05:02:53 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:02:53 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:02:53 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:02:53 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:02:53 user nova-compute[75260]:   </clock>
Nov 27 05:02:53 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:02:53 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:02:53 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:02:53 user nova-compute[75260]:   </cpu>
Nov 27 05:02:53 user nova-compute[75260]:   <devices>
Nov 27 05:02:53 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 05:02:53 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 05:02:53 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk"/>
Nov 27 05:02:53 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:02:53 user nova-compute[75260]:     </disk>
Nov 27 05:02:53 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:02:53 user nova-compute[75260]:       <mac address="fa:16:3e:44:e4:f8"/>
Nov 27 05:02:53 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:02:53 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:02:53 user nova-compute[75260]:       <target dev="tapcaaf84bc-70"/>
Nov 27 05:02:53 user nova-compute[75260]:     </interface>
Nov 27 05:02:53 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:02:53 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/console.log" append="off"/>
Nov 27 05:02:53 user nova-compute[75260]:     </serial>
Nov 27 05:02:53 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:02:53 user nova-compute[75260]:     <video>
Nov 27 05:02:53 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:02:53 user nova-compute[75260]:     </video>
Nov 27 05:02:53 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:02:53 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:02:53 user nova-compute[75260]:     </rng>
Nov 27 05:02:53 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:02:53 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:02:53 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:02:53 user nova-compute[75260]:     </memballoon>
Nov 27 05:02:53 user nova-compute[75260]:   </devices>
Nov 27 05:02:53 user nova-compute[75260]: </domain>
Nov 27 05:02:53 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-693034548',display_name='tempest-TestMinimumBasicScenario-server-693034548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-693034548',id=43,image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU2zN3v9oVCiggBA5zHD8JmoZleg+rDjqNxhjG4l1CzZldqjmA/+FDQYVcFjRfjYVF7IVddPZ6X7/dbN3Vp3r6Rl3gM0ey358L9QSrG80I2HFLoYJV6FdEaOHxVFljKXg==',key_name='tempest-TestMinimumBasicScenario-494858082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fc3728cb2564827a26f40cbc0ec6b5f',ramdisk_id='',reservation_id='r-1pgqw0l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-372834875',owner_user_name='tempest-TestMinimumBasicScenario-372834875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:02:51Z,user_data=None,user_id='e509f168517f4fef82ce3d34122fd59d',uuid=dc56ef1d-a722-4c3d-9d24-b7233d18018c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converting VIF {"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG os_vif [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fb388fe-964f-5d08-a79d-30100167cdc5', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcaaf84bc-70, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcaaf84bc-70, col_values=(('qos', UUID('8cdf8574-7d7e-42c0-946d-f46b45adac41')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcaaf84bc-70, col_values=(('external_ids', {'iface-id': 'caaf84bc-7039-4868-99b4-391387bd4a1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:e4:f8', 'vm-uuid': 'dc56ef1d-a722-4c3d-9d24-b7233d18018c'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:53 user nova-compute[75260]: INFO os_vif [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70')
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] No VIF found with MAC fa:16:3e:44:e4:f8, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-835d829a-2908-4b58-80e7-527e83067757 req-a8680517-d5fc-4b17-b431-8f6c18c92fca service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updated VIF entry in instance network info cache for port caaf84bc-7039-4868-99b4-391387bd4a1e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-835d829a-2908-4b58-80e7-527e83067757 req-a8680517-d5fc-4b17-b431-8f6c18c92fca service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updating instance_info_cache with network_info: [{"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:02:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-835d829a-2908-4b58-80e7-527e83067757 req-a8680517-d5fc-4b17-b431-8f6c18c92fca service nova] Releasing lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:02:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c6b5d51-1557-42c8-8f19-38c3bd1e9c8f req-4d12fabd-9538-492b-b66c-3ccc85f6be22 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:02:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c6b5d51-1557-42c8-8f19-38c3bd1e9c8f req-4d12fabd-9538-492b-b66c-3ccc85f6be22 service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c6b5d51-1557-42c8-8f19-38c3bd1e9c8f req-4d12fabd-9538-492b-b66c-3ccc85f6be22 service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c6b5d51-1557-42c8-8f19-38c3bd1e9c8f req-4d12fabd-9538-492b-b66c-3ccc85f6be22 service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c6b5d51-1557-42c8-8f19-38c3bd1e9c8f req-4d12fabd-9538-492b-b66c-3ccc85f6be22 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:02:54 user nova-compute[75260]: WARNING nova.compute.manager [req-4c6b5d51-1557-42c8-8f19-38c3bd1e9c8f req-4d12fabd-9538-492b-b66c-3ccc85f6be22 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state building and task_state spawning.
Nov 27 05:02:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kLXpqYAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:02:55 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:02:55 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:02:55 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c059f23d-1179-4223-a94f-9ad75eea9357]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:02:55 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8560256c-c112-4deb-9b7c-2e6f6077716c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047] added
Nov 27 05:02:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2a1455-8794-40b8-927c-edf348e3e0a7]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7c0dc0-aa08-42c4-8a0f-13dbcfe12831]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kLXpqYAb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kLXpqYAb" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc9c166-dc8a-43ee-a72b-a94d2d98fcb4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kLXpqYAb'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0193d7-a9b4-48b3-80e2-a908d610b16e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc79e3b3-6a00-4185-8d9b-259234e58013]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:02:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:02:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ded1a0f-4493-46b6-a0a2-7d5cd341ed4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047, portal: 172.16.0.220,3260]
Nov 27 05:02:55 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047, portal: 172.16.0.220,3260] successful.
Nov 27 05:02:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.049s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[20409e3f-7023-4c82-bb6c-844b46735b8a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0482b9-5423-47e9-9cac-2fcac49e09e2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 (non-flash)
Nov 27 05:02:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:02:55 user nova-compute[75260]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 (non-flash)
Nov 27 05:02:55 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28dc627-8dcb-4fd2-8e99-3881ff65da7d]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:02:55 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kLXpqYAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-43d36013-972c-48f2-97d5-0f6e055e8dd6 req-b149d9f1-0d00-4589-a6f0-91978b8668d0 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-43d36013-972c-48f2-97d5-0f6e055e8dd6 req-b149d9f1-0d00-4589-a6f0-91978b8668d0 service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-43d36013-972c-48f2-97d5-0f6e055e8dd6 req-b149d9f1-0d00-4589-a6f0-91978b8668d0 service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-43d36013-972c-48f2-97d5-0f6e055e8dd6 req-b149d9f1-0d00-4589-a6f0-91978b8668d0 service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-43d36013-972c-48f2-97d5-0f6e055e8dd6 req-b149d9f1-0d00-4589-a6f0-91978b8668d0 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:02:56 user nova-compute[75260]: WARNING nova.compute.manager [req-43d36013-972c-48f2-97d5-0f6e055e8dd6 req-b149d9f1-0d00-4589-a6f0-91978b8668d0 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state building and task_state spawning.
Nov 27 05:02:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23634383733336635', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634383733336635', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.objects.instance [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:02:56 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Instance spawned successfully.
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 05:02:56 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:02:56 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:02:56 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:02:56 user nova-compute[75260]:   <serial>b5bc20ce-4879-4a67-b438-a5e1b5680047</serial>
Nov 27 05:02:56 user nova-compute[75260]: </disk>
Nov 27 05:02:56 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:02:56 user nova-compute[75260]: INFO nova.compute.manager [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 27 05:02:56 user nova-compute[75260]: DEBUG nova.compute.manager [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:02:57 user nova-compute[75260]: INFO nova.compute.manager [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Took 6.65 seconds to build instance.
Nov 27 05:02:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-eb84c06e-42ff-4813-ade3-4e1e2be36964 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.765s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] No VIF found with MAC fa:16:3e:12:c4:7b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-449f4298-81b2-4341-b377-ccbd2eaac291 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.848s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:02:57 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:02:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:02:58 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updating instance_info_cache with network_info: [{"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:02:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-4bff94d1-4400-4dff-baff-fc10c8070b05" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:02:58 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:02:58 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:02:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:02:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:03:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:00 user nova-compute[75260]: INFO nova.compute.manager [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Detaching volume b5bc20ce-4879-4a67-b438-a5e1b5680047
Nov 27 05:03:00 user nova-compute[75260]: INFO nova.virt.block_device [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Attempting to driver detach volume b5bc20ce-4879-4a67-b438-a5e1b5680047 from mountpoint /dev/vdb
Nov 27 05:03:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Attempting to detach device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 05:03:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:03:00 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:03:00 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:03:00 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:03:00 user nova-compute[75260]:   <serial>b5bc20ce-4879-4a67-b438-a5e1b5680047</serial>
Nov 27 05:03:00 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 05:03:00 user nova-compute[75260]: </disk>
Nov 27 05:03:00 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:03:00 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Successfully detached device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the persistent domain config.
Nov 27 05:03:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 05:03:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:03:00 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:03:00 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:03:00 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:03:00 user nova-compute[75260]:   <serial>b5bc20ce-4879-4a67-b438-a5e1b5680047</serial>
Nov 27 05:03:00 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 05:03:00 user nova-compute[75260]: </disk>
Nov 27 05:03:00 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:03:00 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 05:03:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:03:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:03:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:03:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:03 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:03:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:03 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:04 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/disk.rescue --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:03:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:06 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:03:06 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=7913MB free_disk=25.023799896240234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1a25081f-79d1-412f-bf99-4235516d40a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4bff94d1-4400-4dff-baff-fc10c8070b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 25fc2351-09a3-4d9f-83b7-485677fa8caf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4f619b72-fa16-4ae8-8693-00b8d2fa5910 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance dc56ef1d-a722-4c3d-9d24-b7233d18018c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:03:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:03:07 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:03:07 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:03:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:03:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:03:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:20 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 is timed out.
Nov 27 05:03:20 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Successfully detached device vdb from instance 4bff94d1-4400-4dff-baff-fc10c8070b05 from the live domain config.
Nov 27 05:03:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kLXpqYAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:03:20 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abdc20f-10d9-45fa-9b4a-5176d7e0d5a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:03:20 user nova-compute[75260]: No targets found.
Nov 27 05:03:20 user nova-compute[75260]: iSNS:
Nov 27 05:03:20 user nova-compute[75260]: No targets found.
Nov 27 05:03:20 user nova-compute[75260]: STATIC:
Nov 27 05:03:20 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:03:20 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:03:20 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:03:20 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 05:03:20 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:03:20 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:03:20 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047
Nov 27 05:03:20 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:03:20 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:03:20 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69
Nov 27 05:03:20 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:03:20 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:03:20 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e
Nov 27 05:03:20 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:03:20 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:03:20 user nova-compute[75260]: FIRMWARE:
Nov 27 05:03:20 user nova-compute[75260]: No targets found.
Nov 27 05:03:20 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:03:20 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:03:20 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[63be5755-f48c-4a2c-8fe1-f6fed0eaa094]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b476d6c0-e33e-4bd2-8269-725c6d36fb24]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:03:20 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:03:20 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:03:20 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:03:20 user nova-compute[75260]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 (non-flash)
Nov 27 05:03:20 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:03:20 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:03:20 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:03:20 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:03:20 user nova-compute[75260]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 (non-flash)
Nov 27 05:03:20 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c2b5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[52251a3d-2fb5-4c58-ac74-5e4eb15312c2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[30762368-1687-4b4e-8828-6f54488930aa]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[44808eaf-a0cb-4047-bab5-74f28b710a77]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b286b0-f97e-4806-ad15-1a9cd55fa582]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f44536e-0b44-454d-8a14-3fbe72f61b15]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a064e8-3a18-49e5-b6e2-bfefab981d77]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047, portal: 172.16.0.220,3260]
Nov 27 05:03:20 user nova-compute[75260]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047, portal: 172.16.0.220,3260] successful.
Nov 27 05:03:20 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bc20ce-4879-4a67-b438-a5e1b5680047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d2d30b-bcdf-4587-8253-358dc6a06588]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] <== disconnect_volume: return (338ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:03:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:03:21 user nova-compute[75260]: DEBUG nova.objects.instance [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'flavor' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:03:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6fba7c2f-3006-4641-ab1a-1228f52e1bda tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:26 user nova-compute[75260]: INFO nova.compute.manager [None req-785f3ae5-d4be-4581-87a5-420f1135336e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Get console output
Nov 27 05:03:27 user nova-compute[75260]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 27 05:03:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:03:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:03:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:03:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:03:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:03:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:03:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:03:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:03:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:03:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:03:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:03:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-6656281d-3cd8-48d7-aa18-978cb819b987 req-fd494465-e52c-4acf-8c62-9d691e2d5ac1 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-changed-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:03:50 user nova-compute[75260]: DEBUG nova.compute.manager [req-6656281d-3cd8-48d7-aa18-978cb819b987 req-fd494465-e52c-4acf-8c62-9d691e2d5ac1 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Refreshing instance network info cache due to event network-changed-98eae3b9-3a88-4152-a0f4-feef155827e0. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:03:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6656281d-3cd8-48d7-aa18-978cb819b987 req-fd494465-e52c-4acf-8c62-9d691e2d5ac1 service nova] Acquiring lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:03:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6656281d-3cd8-48d7-aa18-978cb819b987 req-fd494465-e52c-4acf-8c62-9d691e2d5ac1 service nova] Acquired lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:03:50 user nova-compute[75260]: DEBUG nova.network.neutron [req-6656281d-3cd8-48d7-aa18-978cb819b987 req-fd494465-e52c-4acf-8c62-9d691e2d5ac1 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Refreshing network info cache for port 98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:03:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:50 user nova-compute[75260]: INFO nova.compute.manager [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Terminating instance
Nov 27 05:03:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG nova.network.neutron [req-6656281d-3cd8-48d7-aa18-978cb819b987 req-fd494465-e52c-4acf-8c62-9d691e2d5ac1 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updated VIF entry in instance network info cache for port 98eae3b9-3a88-4152-a0f4-feef155827e0. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG nova.network.neutron [req-6656281d-3cd8-48d7-aa18-978cb819b987 req-fd494465-e52c-4acf-8c62-9d691e2d5ac1 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating instance_info_cache with network_info: [{"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6656281d-3cd8-48d7-aa18-978cb819b987 req-fd494465-e52c-4acf-8c62-9d691e2d5ac1 service nova] Releasing lock "refresh_cache-4f619b72-fa16-4ae8-8693-00b8d2fa5910" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Instance destroyed successfully.
Nov 27 05:03:51 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lazy-loading 'resources' on Instance uuid 4f619b72-fa16-4ae8-8693-00b8d2fa5910 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T04:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1751229513',display_name='tempest-TestShelveInstance-server-1751229513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1751229513',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTjm39bq9T3Aj9FAOay1ZJVrSQPO1ihgbXN1DUbPUuuVmLiFKRDNNnD6W9uzjR++u8JrbTp6q95i4UZh9F8GHb11y8Dz1R3heMWfS6Cxl4yoYMnLOlSvj4cXiW8AYfO0w==',key_name='tempest-TestShelveInstance-141016732',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:02:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bdd9716601a4207b876ddcffff6458c',ramdisk_id='',reservation_id='r-ilmv1pst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1324535314',owner_user_name='tempest-TestShelveInstance-1324535314-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:02:15Z,user_data=None,user_id='2e48682a815e4ec38876b91a70718ed2',uuid=4f619b72-fa16-4ae8-8693-00b8d2fa5910,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converting VIF {"id": "98eae3b9-3a88-4152-a0f4-feef155827e0", "address": "fa:16:3e:fc:40:25", "network": {"id": "a94f0ffb-d3da-47dc-8cf6-52b60145cac6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1185466701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bdd9716601a4207b876ddcffff6458c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eae3b9-3a", "ovs_interfaceid": "98eae3b9-3a88-4152-a0f4-feef155827e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_vif [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98eae3b9-3a, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebdc2f73-9dd9-4a50-a74f-af58f22cf76b) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:03:51 user nova-compute[75260]: INFO os_vif [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:40:25,bridge_name='br-int',has_traffic_filtering=True,id=98eae3b9-3a88-4152-a0f4-feef155827e0,network=Network(a94f0ffb-d3da-47dc-8cf6-52b60145cac6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eae3b9-3a')
Nov 27 05:03:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASLuoGVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:03:51 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb81285-ce74-41b2-81f6-0bf18d62483f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:03:51 user nova-compute[75260]: No targets found.
Nov 27 05:03:51 user nova-compute[75260]: iSNS:
Nov 27 05:03:51 user nova-compute[75260]: No targets found.
Nov 27 05:03:51 user nova-compute[75260]: STATIC:
Nov 27 05:03:51 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:03:51 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:03:51 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:03:51 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 05:03:51 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:03:51 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:03:51 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69
Nov 27 05:03:51 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:03:51 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:03:51 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e
Nov 27 05:03:51 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:03:51 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:03:51 user nova-compute[75260]: FIRMWARE:
Nov 27 05:03:51 user nova-compute[75260]: No targets found.
Nov 27 05:03:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:03:51 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:03:51 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad0dc92-0d26-4884-b35e-d67d34a015a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d5cab5-773e-4c67-afe6-8fa68eb7015b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:03:51 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:03:51 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:03:51 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:03:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:03:51 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:03:51 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:03:51 user nova-compute[75260]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e (non-flash)
Nov 27 05:03:51 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54254f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e'): ({'sde'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Removing single pathed devices sde {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6c29a9-6373-4c27-908d-d9e3138cb4fa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.045s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b0039b-0887-4fcc-80f8-a6255992068a]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Flushing IO for device /dev/sde {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:03:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcc2fe5-9620-448b-915e-7d23160c48b1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.071s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[949efc0c-fb09-4e30-a200-d3fac1157560]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef9641-3314-4e9a-b460-5c471827265a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3f4952-773c-4118-a004-44e904c1d51d]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260]
Nov 27 05:03:52 user nova-compute[75260]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e, portal: 172.16.0.220,3260] successful.
Nov 27 05:03:52 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e67cdb0-e77b-4a92-b2fc-a44eca67d54e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e877c3-b5a6-48e0-b5d8-6b705ebcf79b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] <== disconnect_volume: return (433ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:03:52 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Deleting instance files /opt/stack/data/nova/instances/4f619b72-fa16-4ae8-8693-00b8d2fa5910_del
Nov 27 05:03:52 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Deletion of /opt/stack/data/nova/instances/4f619b72-fa16-4ae8-8693-00b8d2fa5910_del complete
Nov 27 05:03:52 user nova-compute[75260]: INFO nova.compute.manager [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:03:52 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Took 0.54 seconds to deallocate network for instance.
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-5e58e3e1-0e98-4c6e-9741-eaf03706e4aa req-3ceb608c-150f-4df6-9fe6-5e10f4ce591f service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-deleted-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:03:52 user nova-compute[75260]: INFO nova.compute.manager [req-5e58e3e1-0e98-4c6e-9741-eaf03706e4aa req-3ceb608c-150f-4df6-9fe6-5e10f4ce591f service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Neutron deleted interface 98eae3b9-3a88-4152-a0f4-feef155827e0; detaching it from the instance and deleting it from the info cache
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.network.neutron [req-5e58e3e1-0e98-4c6e-9741-eaf03706e4aa req-3ceb608c-150f-4df6-9fe6-5e10f4ce591f service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-5e58e3e1-0e98-4c6e-9741-eaf03706e4aa req-3ceb608c-150f-4df6-9fe6-5e10f4ce591f service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Detach interface failed, port_id=98eae3b9-3a88-4152-a0f4-feef155827e0, reason: Instance 4f619b72-fa16-4ae8-8693-00b8d2fa5910 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-unplugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-unplugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-unplugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:03:52 user nova-compute[75260]: WARNING nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received unexpected event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with vm_state active and task_state deleting.
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:03:52 user nova-compute[75260]: WARNING nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received unexpected event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with vm_state active and task_state deleting.
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:03:52 user nova-compute[75260]: WARNING nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received unexpected event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with vm_state active and task_state deleting.
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-unplugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-unplugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-unplugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Acquiring lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] No waiting events found dispatching network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:03:52 user nova-compute[75260]: WARNING nova.compute.manager [req-de565029-d5f2-4397-b061-5ab07604c214 req-6a36177a-13d8-4e0b-8794-39b20c9700a4 service nova] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Received unexpected event network-vif-plugged-98eae3b9-3a88-4152-a0f4-feef155827e0 for instance with vm_state active and task_state deleting.
Nov 27 05:03:53 user nova-compute[75260]: INFO nova.compute.manager [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Took 1.06 seconds to detach 1 volumes for instance.
Nov 27 05:03:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] [instance: 4f619b72-fa16-4ae8-8693-00b8d2fa5910] Deleting volume: 4e67cdb0-e77b-4a92-b2fc-a44eca67d54e {{(pid=75260) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 05:03:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:54 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:03:54 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:03:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:54 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Deleted allocations for instance 4f619b72-fa16-4ae8-8693-00b8d2fa5910
Nov 27 05:03:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3f5db272-b7b3-4aab-8ab0-ca8e880ec2dc tempest-TestShelveInstance-1324535314 tempest-TestShelveInstance-1324535314-project-member] Lock "4f619b72-fa16-4ae8-8693-00b8d2fa5910" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.532s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:55 user nova-compute[75260]: INFO nova.compute.manager [None req-0814b651-cd6f-4ff7-8547-09322a8e99e4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Unrescuing
Nov 27 05:03:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0814b651-cd6f-4ff7-8547-09322a8e99e4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0814b651-cd6f-4ff7-8547-09322a8e99e4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquired lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0814b651-cd6f-4ff7-8547-09322a8e99e4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG nova.network.neutron [None req-0814b651-cd6f-4ff7-8547-09322a8e99e4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Updating instance_info_cache with network_info: [{"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-0814b651-cd6f-4ff7-8547-09322a8e99e4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Releasing lock "refresh_cache-25fc2351-09a3-4d9f-83b7-485677fa8caf" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG nova.objects.instance [None req-0814b651-cd6f-4ff7-8547-09322a8e99e4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'flavor' on Instance uuid 25fc2351-09a3-4d9f-83b7-485677fa8caf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6871d58-5ea6-4112-ba99-0d29df98876c req-56e8dcd4-06cd-42ca-aa52-6f81302b4f37 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-unplugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6871d58-5ea6-4112-ba99-0d29df98876c req-56e8dcd4-06cd-42ca-aa52-6f81302b4f37 service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6871d58-5ea6-4112-ba99-0d29df98876c req-56e8dcd4-06cd-42ca-aa52-6f81302b4f37 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a6871d58-5ea6-4112-ba99-0d29df98876c req-56e8dcd4-06cd-42ca-aa52-6f81302b4f37 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6871d58-5ea6-4112-ba99-0d29df98876c req-56e8dcd4-06cd-42ca-aa52-6f81302b4f37 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-unplugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:03:55 user nova-compute[75260]: WARNING nova.compute.manager [req-a6871d58-5ea6-4112-ba99-0d29df98876c req-56e8dcd4-06cd-42ca-aa52-6f81302b4f37 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-unplugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state rescued and task_state unrescuing.
Nov 27 05:03:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:56 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Instance destroyed successfully.
Nov 27 05:03:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-21b08929-5919-4c84-9e95-6ea778de0924 req-d5b7d612-efae-4aef-b0d3-05f3ab3250e3 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:03:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-21b08929-5919-4c84-9e95-6ea778de0924 req-d5b7d612-efae-4aef-b0d3-05f3ab3250e3 service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:03:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-21b08929-5919-4c84-9e95-6ea778de0924 req-d5b7d612-efae-4aef-b0d3-05f3ab3250e3 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:03:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-21b08929-5919-4c84-9e95-6ea778de0924 req-d5b7d612-efae-4aef-b0d3-05f3ab3250e3 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:03:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-21b08929-5919-4c84-9e95-6ea778de0924 req-d5b7d612-efae-4aef-b0d3-05f3ab3250e3 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:03:57 user nova-compute[75260]: WARNING nova.compute.manager [req-21b08929-5919-4c84-9e95-6ea778de0924 req-d5b7d612-efae-4aef-b0d3-05f3ab3250e3 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state rescued and task_state unrescuing.
Nov 27 05:03:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating instance_info_cache with network_info: [{"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:03:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-0814b651-cd6f-4ff7-8547-09322a8e99e4 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:04:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:04:00 user nova-compute[75260]: WARNING nova.compute.manager [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state rescued and task_state unrescuing.
Nov 27 05:04:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:04:00 user nova-compute[75260]: WARNING nova.compute.manager [req-e22e8a9a-3ed7-46c4-9180-828ca04eba14 req-a414c963-4729-4efd-9468-9c7cfe9e7d4b service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state rescued and task_state unrescuing.
Nov 27 05:04:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:04:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:04:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:04:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:04 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:04:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:07 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:04:07 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8148MB free_disk=24.995277404785156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1a25081f-79d1-412f-bf99-4235516d40a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 4bff94d1-4400-4dff-baff-fc10c8070b05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 25fc2351-09a3-4d9f-83b7-485677fa8caf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance dc56ef1d-a722-4c3d-9d24-b7233d18018c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:04:07 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:04:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:04:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:13 user nova-compute[75260]: INFO nova.compute.manager [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Terminating instance
Nov 27 05:04:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG nova.compute.manager [req-eee6d367-1e47-4321-b1b9-2b541b53690a req-05753744-c096-4bc6-95f4-f35e9c857e9b service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-vif-unplugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eee6d367-1e47-4321-b1b9-2b541b53690a req-05753744-c096-4bc6-95f4-f35e9c857e9b service nova] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eee6d367-1e47-4321-b1b9-2b541b53690a req-05753744-c096-4bc6-95f4-f35e9c857e9b service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-eee6d367-1e47-4321-b1b9-2b541b53690a req-05753744-c096-4bc6-95f4-f35e9c857e9b service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG nova.compute.manager [req-eee6d367-1e47-4321-b1b9-2b541b53690a req-05753744-c096-4bc6-95f4-f35e9c857e9b service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] No waiting events found dispatching network-vif-unplugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:04:13 user nova-compute[75260]: DEBUG nova.compute.manager [req-eee6d367-1e47-4321-b1b9-2b541b53690a req-05753744-c096-4bc6-95f4-f35e9c857e9b service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-vif-unplugged-1cac0fe3-e9cf-4557-a30d-8182575753cd for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Instance destroyed successfully.
Nov 27 05:04:14 user nova-compute[75260]: DEBUG nova.objects.instance [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lazy-loading 'resources' on Instance uuid 4bff94d1-4400-4dff-baff-fc10c8070b05 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2079771585',display_name='tempest-SnapshotDataIntegrityTests-server-2079771585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2079771585',id=38,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGfiekAeXvgi87pSAzZd6whmDDd7bDfEO+/NumlFGy4xCwbIrJLHiuHCSz4HNHZug1RjAgIxYirr1+PtEXSK7+Mx3m+zeLwG1GHkzRHltHkM6aeskPMZ2sman6JmXhV8g==',key_name='tempest-keypair-1713085007',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:57:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b409ff46f9cd4a769e77b24b7273e921',ramdisk_id='',reservation_id='r-1dy3bzc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1092427161',owner_user_name='tempest-SnapshotDataIntegrityTests-1092427161-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5627a212f5a94891a5c90811cffbcb66',uuid=4bff94d1-4400-4dff-baff-fc10c8070b05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Converting VIF {"id": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "address": "fa:16:3e:12:c4:7b", "network": {"id": "9db38faa-e099-4d3c-bbad-b2a54391506c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-318550172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b409ff46f9cd4a769e77b24b7273e921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cac0fe3-e9", "ovs_interfaceid": "1cac0fe3-e9cf-4557-a30d-8182575753cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:c4:7b,bridge_name='br-int',has_traffic_filtering=True,id=1cac0fe3-e9cf-4557-a30d-8182575753cd,network=Network(9db38faa-e099-4d3c-bbad-b2a54391506c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cac0fe3-e9') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG os_vif [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:c4:7b,bridge_name='br-int',has_traffic_filtering=True,id=1cac0fe3-e9cf-4557-a30d-8182575753cd,network=Network(9db38faa-e099-4d3c-bbad-b2a54391506c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cac0fe3-e9') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cac0fe3-e9, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f94e268-7415-44a0-87a0-59d0e5cd7c27) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:14 user nova-compute[75260]: INFO os_vif [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:c4:7b,bridge_name='br-int',has_traffic_filtering=True,id=1cac0fe3-e9cf-4557-a30d-8182575753cd,network=Network(9db38faa-e099-4d3c-bbad-b2a54391506c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cac0fe3-e9')
Nov 27 05:04:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Deleting instance files /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05_del
Nov 27 05:04:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Deletion of /opt/stack/data/nova/instances/4bff94d1-4400-4dff-baff-fc10c8070b05_del complete
Nov 27 05:04:14 user nova-compute[75260]: INFO nova.compute.manager [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 27 05:04:14 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:15 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:04:15 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Took 0.92 seconds to deallocate network for instance.
Nov 27 05:04:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-d0057bfa-d38e-44df-a6bb-4d1b4f753f2d req-bfa7b26b-693b-42fd-9b00-5d99ed063d90 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-vif-deleted-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:15 user nova-compute[75260]: INFO nova.compute.manager [req-d0057bfa-d38e-44df-a6bb-4d1b4f753f2d req-bfa7b26b-693b-42fd-9b00-5d99ed063d90 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Neutron deleted interface 1cac0fe3-e9cf-4557-a30d-8182575753cd; detaching it from the instance and deleting it from the info cache
Nov 27 05:04:15 user nova-compute[75260]: DEBUG nova.network.neutron [req-d0057bfa-d38e-44df-a6bb-4d1b4f753f2d req-bfa7b26b-693b-42fd-9b00-5d99ed063d90 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:04:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-d0057bfa-d38e-44df-a6bb-4d1b4f753f2d req-bfa7b26b-693b-42fd-9b00-5d99ed063d90 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Detach interface failed, port_id=1cac0fe3-e9cf-4557-a30d-8182575753cd, reason: Instance 4bff94d1-4400-4dff-baff-fc10c8070b05 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 05:04:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:15 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:04:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:04:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:15 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Deleted allocations for instance 4bff94d1-4400-4dff-baff-fc10c8070b05
Nov 27 05:04:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-2d029814-7e43-4a6a-87c3-0b3eccf7ecb3 tempest-SnapshotDataIntegrityTests-1092427161 tempest-SnapshotDataIntegrityTests-1092427161-project-member] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] No waiting events found dispatching network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:04:16 user nova-compute[75260]: WARNING nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received unexpected event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd for instance with vm_state deleted and task_state None.
Nov 27 05:04:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] No waiting events found dispatching network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:04:16 user nova-compute[75260]: WARNING nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received unexpected event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd for instance with vm_state deleted and task_state None.
Nov 27 05:04:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] No waiting events found dispatching network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:04:16 user nova-compute[75260]: WARNING nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received unexpected event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd for instance with vm_state deleted and task_state None.
Nov 27 05:04:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-vif-unplugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] No waiting events found dispatching network-vif-unplugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:04:16 user nova-compute[75260]: WARNING nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received unexpected event network-vif-unplugged-1cac0fe3-e9cf-4557-a30d-8182575753cd for instance with vm_state deleted and task_state None.
Nov 27 05:04:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Acquiring lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] Lock "4bff94d1-4400-4dff-baff-fc10c8070b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:16 user nova-compute[75260]: DEBUG nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] No waiting events found dispatching network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:04:16 user nova-compute[75260]: WARNING nova.compute.manager [req-75280444-de2c-4fab-9385-c597c542670b req-571f4197-9f58-4676-a4d6-e18401ecee76 service nova] [instance: 4bff94d1-4400-4dff-baff-fc10c8070b05] Received unexpected event network-vif-plugged-1cac0fe3-e9cf-4557-a30d-8182575753cd for instance with vm_state deleted and task_state None.
Nov 27 05:04:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:27 user nova-compute[75260]: INFO nova.compute.manager [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Terminating instance
Nov 27 05:04:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:04:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-6f96b0e8-b109-41c1-9c5e-897c357f6f77 req-6985d7a0-04e4-4009-8be1-8b230a69bd7f service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-vif-unplugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6f96b0e8-b109-41c1-9c5e-897c357f6f77 req-6985d7a0-04e4-4009-8be1-8b230a69bd7f service nova] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6f96b0e8-b109-41c1-9c5e-897c357f6f77 req-6985d7a0-04e4-4009-8be1-8b230a69bd7f service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6f96b0e8-b109-41c1-9c5e-897c357f6f77 req-6985d7a0-04e4-4009-8be1-8b230a69bd7f service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-6f96b0e8-b109-41c1-9c5e-897c357f6f77 req-6985d7a0-04e4-4009-8be1-8b230a69bd7f service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] No waiting events found dispatching network-vif-unplugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-6f96b0e8-b109-41c1-9c5e-897c357f6f77 req-6985d7a0-04e4-4009-8be1-8b230a69bd7f service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-vif-unplugged-98655667-82da-4c3f-8724-e58493868afe for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Instance destroyed successfully.
Nov 27 05:04:28 user nova-compute[75260]: DEBUG nova.objects.instance [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'resources' on Instance uuid 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2106560057',display_name='tempest-ServerActionsTestOtherA-server-2106560057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2106560057',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOij+0g1QbUNojcJl3yIM3Tv96IeOdvkNKm5ThbXwXoQhcjwE76rap7fFhOUAjRiN20jCHkXP7XPhGl+HzdyShkrkNHzkMrulgl7gxlMCqAAOAl9YSxm9bSuYOmPOCmkIw==',key_name='tempest-keypair-1643056830',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:00:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-tj0rxw1j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=37cf41f0-c27b-4e5c-bc20-1b7d79daac1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "98655667-82da-4c3f-8724-e58493868afe", "address": "fa:16:3e:41:ff:72", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98655667-82", "ovs_interfaceid": "98655667-82da-4c3f-8724-e58493868afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_vif [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98655667-82, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59618284-9b4c-4475-bb58-96921c5566be) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:04:28 user nova-compute[75260]: INFO os_vif [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:ff:72,bridge_name='br-int',has_traffic_filtering=True,id=98655667-82da-4c3f-8724-e58493868afe,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98655667-82')
Nov 27 05:04:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlxOncWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:04:28 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee84868-7e2e-44f0-84d9-a7fac2780040]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:04:28 user nova-compute[75260]: No targets found.
Nov 27 05:04:28 user nova-compute[75260]: iSNS:
Nov 27 05:04:28 user nova-compute[75260]: No targets found.
Nov 27 05:04:28 user nova-compute[75260]: STATIC:
Nov 27 05:04:28 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:04:28 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:04:28 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:04:28 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe
Nov 27 05:04:28 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:04:28 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:04:28 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69
Nov 27 05:04:28 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:04:28 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:04:28 user nova-compute[75260]: FIRMWARE:
Nov 27 05:04:28 user nova-compute[75260]: No targets found.
Nov 27 05:04:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:04:28 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:04:28 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bc58ad-8353-4df8-8a50-8350d3ba1cb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cda7943-d26c-468d-bfac-f78ecf9899d4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:04:28 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:04:28 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:04:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:04:28 user nova-compute[75260]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe (non-flash)
Nov 27 05:04:28 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:04:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb77cded40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7421c191-3cc5-4d38-b44e-3ba9ec45f12c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0687fec-83aa-445a-96d3-603041f0c47b]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9417910f-33c9-48b0-971c-04b69fca0d01]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7a91a7-adba-4ba4-9a36-a9f41aaa9ae4]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23438373864323337', '/dev/disk/by-id/scsi-1SCST_BIO79828f19-4878d2377ce4510b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_79828f19') {{(pid=85819) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ffcc30-21f5-4072-8383-7330fec9d4af]: (4, None) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e37892-83f3-4492-aa67-9097c491ecf4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edb4366-bbdd-4ff5-b919-05458cc26d99]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260]
Nov 27 05:04:28 user nova-compute[75260]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe, portal: 172.16.0.220,3260] successful.
Nov 27 05:04:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df351ca-661d-479f-b9b0-d7fa7dc6e3fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:29 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b513127-5506-4f7f-b350-09e090466b7b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:04:29 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] <== disconnect_volume: return (315ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:04:29 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:04:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Deleting instance files /opt/stack/data/nova/instances/37cf41f0-c27b-4e5c-bc20-1b7d79daac1d_del
Nov 27 05:04:29 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Deletion of /opt/stack/data/nova/instances/37cf41f0-c27b-4e5c-bc20-1b7d79daac1d_del complete
Nov 27 05:04:29 user nova-compute[75260]: INFO nova.compute.manager [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 27 05:04:29 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:04:29 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:04:29 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:04:29 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:04:29 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Took 0.69 seconds to deallocate network for instance.
Nov 27 05:04:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-643b7143-42b3-460f-85d5-2b6dac4bd61d req-a13ccbb4-35f2-4081-af6d-f874b0b8fe49 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-vif-deleted-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-cb6b996d-0b37-4f90-af76-ea831de116fb req-ce5a74f8-e314-4814-983f-ca18438bb474 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cb6b996d-0b37-4f90-af76-ea831de116fb req-ce5a74f8-e314-4814-983f-ca18438bb474 service nova] Acquiring lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cb6b996d-0b37-4f90-af76-ea831de116fb req-ce5a74f8-e314-4814-983f-ca18438bb474 service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cb6b996d-0b37-4f90-af76-ea831de116fb req-ce5a74f8-e314-4814-983f-ca18438bb474 service nova] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-cb6b996d-0b37-4f90-af76-ea831de116fb req-ce5a74f8-e314-4814-983f-ca18438bb474 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] No waiting events found dispatching network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:04:30 user nova-compute[75260]: WARNING nova.compute.manager [req-cb6b996d-0b37-4f90-af76-ea831de116fb req-ce5a74f8-e314-4814-983f-ca18438bb474 service nova] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Received unexpected event network-vif-plugged-98655667-82da-4c3f-8724-e58493868afe for instance with vm_state active and task_state deleting.
Nov 27 05:04:30 user nova-compute[75260]: INFO nova.compute.manager [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Took 0.80 seconds to detach 1 volumes for instance.
Nov 27 05:04:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d] Deleting volume: 7df351ca-661d-479f-b9b0-d7fa7dc6e3fe {{(pid=75260) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 05:04:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:30 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:04:30 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:04:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:30 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Deleted allocations for instance 37cf41f0-c27b-4e5c-bc20-1b7d79daac1d
Nov 27 05:04:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-4505730d-d6c4-4b4e-9571-41afc8058b7e tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "37cf41f0-c27b-4e5c-bc20-1b7d79daac1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.243s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:04:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:04:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:04:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:04:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'flavor' on Instance uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:04:43 user nova-compute[75260]: INFO nova.compute.manager [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Attaching volume 4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 to /dev/vdb
Nov 27 05:04:43 user nova-compute[75260]: DEBUG os_brick.utils [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7779cead-fc11-4739-9d5b-a588b3941cc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[038a9d75-90b9-4b4a-bc1a-37a17f3fc3bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7192dff-043f-4fca-8f95-d6991b30b97f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1ea89f-f0b9-45e3-935f-5b2cd5cd0d61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:04:43 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:04:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[001932e7-7f38-4ced-a4fc-c1c8add91d30]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG os_brick.utils [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updating existing volume attachment record: bf707f84-a50b-4a80-b629-a98ca9d09a97 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:04:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLVDsNTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:04:50 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:04:50 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:04:50 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f504fb15-27dc-499c-bb9b-b73d4e206210]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:04:50 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4290c9cc-1c77-41ee-8103-038c73fe26f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64] added
Nov 27 05:04:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3e9c4c-5012-4b2a-bcce-87719e115fab]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52f3eb3-f1ec-448c-890d-f240f7e334eb]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eLVDsNTk {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eLVDsNTk" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbab325-4ac2-4e14-a373-cc5b55712e54]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eLVDsNTk'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f882975b-c93d-493c-83c2-1019db16a6c6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea65824-c86a-40c3-b0ea-487812e311be]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:04:50 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:04:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:04:50 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:04:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d4d679-8d8b-4dc3-b61a-ed25b3d8517b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260]
Nov 27 05:04:50 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260] successful.
Nov 27 05:04:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afdaaf6-d534-4476-9a30-b2149f0ea603]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c88341-7380-4504-8fe8-05990c47b003]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:04:50 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:04:50 user nova-compute[75260]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:04:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:04:50 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:04:50 user nova-compute[75260]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:04:50 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc58a8f2-966f-4067-a8bb-968cda9bec9e]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLVDsNTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:04:50 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:04:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:04:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23463356635376561', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:04:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463356635376561', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:04:51 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'flavor' on Instance uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:04:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 05:04:51 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:04:51 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 05:04:51 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:04:51 user nova-compute[75260]:   <serial>4a2f1d7f-0de6-4670-a069-a1dbc7c99a64</serial>
Nov 27 05:04:51 user nova-compute[75260]: </disk>
Nov 27 05:04:51 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 05:04:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:04:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:04:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] No VIF found with MAC fa:16:3e:44:e4:f8, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:04:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3908321-3ab0-492d-a851-e104bb91f715 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.315s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:04:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:56 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:04:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-bdcb84b9-eb4b-4176-a40c-cb0b059b1b42 req-38da7f9f-b445-4cf0-8670-23367f3dd75d service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-changed-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-bdcb84b9-eb4b-4176-a40c-cb0b059b1b42 req-38da7f9f-b445-4cf0-8670-23367f3dd75d service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Refreshing instance network info cache due to event network-changed-caaf84bc-7039-4868-99b4-391387bd4a1e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:04:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bdcb84b9-eb4b-4176-a40c-cb0b059b1b42 req-38da7f9f-b445-4cf0-8670-23367f3dd75d service nova] Acquiring lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:04:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bdcb84b9-eb4b-4176-a40c-cb0b059b1b42 req-38da7f9f-b445-4cf0-8670-23367f3dd75d service nova] Acquired lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:04:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-bdcb84b9-eb4b-4176-a40c-cb0b059b1b42 req-38da7f9f-b445-4cf0-8670-23367f3dd75d service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Refreshing network info cache for port caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:04:57 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:04:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-bdcb84b9-eb4b-4176-a40c-cb0b059b1b42 req-38da7f9f-b445-4cf0-8670-23367f3dd75d service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updated VIF entry in instance network info cache for port caaf84bc-7039-4868-99b4-391387bd4a1e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:04:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-bdcb84b9-eb4b-4176-a40c-cb0b059b1b42 req-38da7f9f-b445-4cf0-8670-23367f3dd75d service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updating instance_info_cache with network_info: [{"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:04:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bdcb84b9-eb4b-4176-a40c-cb0b059b1b42 req-38da7f9f-b445-4cf0-8670-23367f3dd75d service nova] Releasing lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:04:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:04:58 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:04:58 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:04:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-f3a65d41-2045-4b4e-9b4a-a8f40f571515 req-99b12b91-e271-4e3c-855e-2f26f3ba24bf service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-changed-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:04:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-f3a65d41-2045-4b4e-9b4a-a8f40f571515 req-99b12b91-e271-4e3c-855e-2f26f3ba24bf service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Refreshing instance network info cache due to event network-changed-caaf84bc-7039-4868-99b4-391387bd4a1e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:04:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f3a65d41-2045-4b4e-9b4a-a8f40f571515 req-99b12b91-e271-4e3c-855e-2f26f3ba24bf service nova] Acquiring lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:04:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f3a65d41-2045-4b4e-9b4a-a8f40f571515 req-99b12b91-e271-4e3c-855e-2f26f3ba24bf service nova] Acquired lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:04:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-f3a65d41-2045-4b4e-9b4a-a8f40f571515 req-99b12b91-e271-4e3c-855e-2f26f3ba24bf service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Refreshing network info cache for port caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:04:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-f3a65d41-2045-4b4e-9b4a-a8f40f571515 req-99b12b91-e271-4e3c-855e-2f26f3ba24bf service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updated VIF entry in instance network info cache for port caaf84bc-7039-4868-99b4-391387bd4a1e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:05:00 user nova-compute[75260]: DEBUG nova.network.neutron [req-f3a65d41-2045-4b4e-9b4a-a8f40f571515 req-99b12b91-e271-4e3c-855e-2f26f3ba24bf service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updating instance_info_cache with network_info: [{"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:05:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f3a65d41-2045-4b4e-9b4a-a8f40f571515 req-99b12b91-e271-4e3c-855e-2f26f3ba24bf service nova] Releasing lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:05:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:05:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 05:05:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:05:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:03 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:03 user nova-compute[75260]: INFO nova.compute.manager [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Rebooting instance
Nov 27 05:05:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:05:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquired lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:05:04 user nova-compute[75260]: DEBUG nova.network.neutron [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:05:04 user nova-compute[75260]: DEBUG nova.network.neutron [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updating instance_info_cache with network_info: [{"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:05:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Releasing lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:05:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:05:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.compute.manager [req-f4753585-6a2b-4023-8a55-9a12767546e7 req-4f0a7aca-17c0-4420-a59f-b96cd8d3bf4d service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-unplugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f4753585-6a2b-4023-8a55-9a12767546e7 req-4f0a7aca-17c0-4420-a59f-b96cd8d3bf4d service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f4753585-6a2b-4023-8a55-9a12767546e7 req-4f0a7aca-17c0-4420-a59f-b96cd8d3bf4d service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f4753585-6a2b-4023-8a55-9a12767546e7 req-4f0a7aca-17c0-4420-a59f-b96cd8d3bf4d service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.compute.manager [req-f4753585-6a2b-4023-8a55-9a12767546e7 req-4f0a7aca-17c0-4420-a59f-b96cd8d3bf4d service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-unplugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:05:05 user nova-compute[75260]: WARNING nova.compute.manager [req-f4753585-6a2b-4023-8a55-9a12767546e7 req-4f0a7aca-17c0-4420-a59f-b96cd8d3bf4d service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-unplugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state active and task_state reboot_started_hard.
Nov 27 05:05:05 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Instance destroyed successfully.
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.objects.instance [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'resources' on Instance uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-693034548',display_name='tempest-TestMinimumBasicScenario-server-693034548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-693034548',id=43,image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU2zN3v9oVCiggBA5zHD8JmoZleg+rDjqNxhjG4l1CzZldqjmA/+FDQYVcFjRfjYVF7IVddPZ6X7/dbN3Vp3r6Rl3gM0ey358L9QSrG80I2HFLoYJV6FdEaOHxVFljKXg==',key_name='tempest-TestMinimumBasicScenario-494858082',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fc3728cb2564827a26f40cbc0ec6b5f',ramdisk_id='',reservation_id='r-1pgqw0l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-372834875',owner_user_name='tempest-TestMinimumBasicScenario-372834875-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:05:05Z,user_data=None,user_id='e509f168517f4fef82ce3d34122fd59d',uuid=dc56ef1d-a722-4c3d-9d24-b7233d18018c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converting VIF {"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_vif [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcaaf84bc-70, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cdf8574-7d7e-42c0-946d-f46b45adac41) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:05:05 user nova-compute[75260]: INFO os_vif [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70')
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLVDsNTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:05:05 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[800a53c8-907f-4df2-ad98-060a4d13e411]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:05:05 user nova-compute[75260]: No targets found.
Nov 27 05:05:05 user nova-compute[75260]: iSNS:
Nov 27 05:05:05 user nova-compute[75260]: No targets found.
Nov 27 05:05:05 user nova-compute[75260]: STATIC:
Nov 27 05:05:05 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64
Nov 27 05:05:05 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:05:05 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:05:05 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:05:05 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:05:05 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:05:05 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69
Nov 27 05:05:05 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:05:05 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:05:05 user nova-compute[75260]: FIRMWARE:
Nov 27 05:05:05 user nova-compute[75260]: No targets found.
Nov 27 05:05:05 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:05:05 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:05:05 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9612f748-2949-4dcd-80c9-e469bbf56b72]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea9fe5-8608-4cc3-a10c-145def574b1e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:05 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:05 user nova-compute[75260]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:05:05 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:05 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:05 user nova-compute[75260]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:05:05 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb5410f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf7763c-ba9d-4f4c-bd65-6914d7fd9bf6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fddbe03-26a6-41be-b207-8cda5a9729df]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb3ef90-b844-48ac-a4d1-053187c6362e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bccd0c-b537-4a0c-a6c8-cf7e2d4055fd]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c084f4-8fc3-4ade-a7f7-e9fdfb41f579]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[024ee8ab-54a8-4dce-80c0-175871360ac8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260]
Nov 27 05:05:05 user nova-compute[75260]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260] successful.
Nov 27 05:05:05 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d30a70-16cb-4f19-a352-b10da1a433e6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] <== disconnect_volume: return (314ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Start _get_guest_xml network_info=[{"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=13f29525-2b44-4a8a-be17-73a7879c0207,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '13f29525-2b44-4a8a-be17-73a7879c0207'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'bf707f84-a50b-4a80-b629-a98ca9d09a97', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLVDsNTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'dc56ef1d-a722-4c3d-9d24-b7233d18018c', 'attached_at': '', 'detached_at': '', 'volume_id': '4a2f1d7f-0de6-4670-a069-a1dbc7c99a64', 'serial': '4a2f1d7f-0de6-4670-a069-a1dbc7c99a64'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:05:05 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:05:05 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=13f29525-2b44-4a8a-be17-73a7879c0207,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.objects.instance [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.objects.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Object Instance<dc56ef1d-a722-4c3d-9d24-b7233d18018c> lazy-loaded attributes: resources,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLVDsNTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:05:05 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:05:05 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:05:05 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bd22df-03b4-4533-99ca-c691b34683d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:05:05 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7687324d-4c93-48f4-89d2-f907d39b9c7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64] added
Nov 27 05:05:05 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a6faf4-c578-4ddd-80da-04c8abea8930]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbdd75e-7812-4f3f-888d-fe0aef3a7743]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eLVDsNTk {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eLVDsNTk" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a993731-0a70-4980-8943-b16a24321827]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eLVDsNTk'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[760bfb9a-ccf2-46fb-8d86-6ac34f71c677]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b355809-e108-4fe7-9237-23da74b5dce6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:06 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:06 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[177e2285-389c-47e4-aa67-d2eb869ba75c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260]
Nov 27 05:05:06 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260] successful.
Nov 27 05:05:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e1b815-f5f8-44e5-8c11-91a232226e10]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd476e4-d99c-4803-9017-547887fee2c4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:06 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:06 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:05:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:06 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:06 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:05:06 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f404ccd7-2b3a-43cf-b641-9299fa88a4d3]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLVDsNTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:06 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-a9e9167c-1997-41ef-b915-8153cc27aa96 req-18de49fb-3d9d-461c-85ca-1247353c5799 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a9e9167c-1997-41ef-b915-8153cc27aa96 req-18de49fb-3d9d-461c-85ca-1247353c5799 service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a9e9167c-1997-41ef-b915-8153cc27aa96 req-18de49fb-3d9d-461c-85ca-1247353c5799 service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a9e9167c-1997-41ef-b915-8153cc27aa96 req-18de49fb-3d9d-461c-85ca-1247353c5799 service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-a9e9167c-1997-41ef-b915-8153cc27aa96 req-18de49fb-3d9d-461c-85ca-1247353c5799 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:05:07 user nova-compute[75260]: WARNING nova.compute.manager [req-a9e9167c-1997-41ef-b915-8153cc27aa96 req-18de49fb-3d9d-461c-85ca-1247353c5799 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state active and task_state reboot_started_hard.
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.754s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] <== connect_volume: return (1755ms) {'type': 'block', 'scsi_wwn': '23463356635376561', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463356635376561', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:05:07 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:05:07 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:05:07 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8462MB free_disk=25.00369644165039GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-693034548',display_name='tempest-TestMinimumBasicScenario-server-693034548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-693034548',id=43,image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU2zN3v9oVCiggBA5zHD8JmoZleg+rDjqNxhjG4l1CzZldqjmA/+FDQYVcFjRfjYVF7IVddPZ6X7/dbN3Vp3r6Rl3gM0ey358L9QSrG80I2HFLoYJV6FdEaOHxVFljKXg==',key_name='tempest-TestMinimumBasicScenario-494858082',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fc3728cb2564827a26f40cbc0ec6b5f',ramdisk_id='',reservation_id='r-1pgqw0l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-372834875',owner_user_name='tempest-TestMinimumBasicScenario-372834875-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:05:05Z,user_data=None,user_id='e509f168517f4fef82ce3d34122fd59d',uuid=dc56ef1d-a722-4c3d-9d24-b7233d18018c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converting VIF {"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG nova.objects.instance [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'pci_devices' on Instance uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG nova.objects.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Object Instance<dc56ef1d-a722-4c3d-9d24-b7233d18018c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:05:07 user nova-compute[75260]:   <uuid>dc56ef1d-a722-4c3d-9d24-b7233d18018c</uuid>
Nov 27 05:05:07 user nova-compute[75260]:   <name>instance-0000002b</name>
Nov 27 05:05:07 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:05:07 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:05:07 user nova-compute[75260]:   <metadata>
Nov 27 05:05:07 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:05:07 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:05:07 user nova-compute[75260]:       <nova:name>tempest-TestMinimumBasicScenario-server-693034548</nova:name>
Nov 27 05:05:07 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:05:05</nova:creationTime>
Nov 27 05:05:07 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:05:07 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:05:07 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:05:07 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:05:07 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:05:07 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:05:07 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:05:07 user nova-compute[75260]:       <nova:owner>
Nov 27 05:05:07 user nova-compute[75260]:         <nova:user uuid="e509f168517f4fef82ce3d34122fd59d">tempest-TestMinimumBasicScenario-372834875-project-member</nova:user>
Nov 27 05:05:07 user nova-compute[75260]:         <nova:project uuid="1fc3728cb2564827a26f40cbc0ec6b5f">tempest-TestMinimumBasicScenario-372834875</nova:project>
Nov 27 05:05:07 user nova-compute[75260]:       </nova:owner>
Nov 27 05:05:07 user nova-compute[75260]:       <nova:root type="image" uuid="13f29525-2b44-4a8a-be17-73a7879c0207"/>
Nov 27 05:05:07 user nova-compute[75260]:       <nova:ports>
Nov 27 05:05:07 user nova-compute[75260]:         <nova:port uuid="caaf84bc-7039-4868-99b4-391387bd4a1e">
Nov 27 05:05:07 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 05:05:07 user nova-compute[75260]:         </nova:port>
Nov 27 05:05:07 user nova-compute[75260]:       </nova:ports>
Nov 27 05:05:07 user nova-compute[75260]:     </nova:instance>
Nov 27 05:05:07 user nova-compute[75260]:   </metadata>
Nov 27 05:05:07 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:05:07 user nova-compute[75260]:     <system>
Nov 27 05:05:07 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:05:07 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:05:07 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:05:07 user nova-compute[75260]:       <entry name="serial">dc56ef1d-a722-4c3d-9d24-b7233d18018c</entry>
Nov 27 05:05:07 user nova-compute[75260]:       <entry name="uuid">dc56ef1d-a722-4c3d-9d24-b7233d18018c</entry>
Nov 27 05:05:07 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:05:07 user nova-compute[75260]:     </system>
Nov 27 05:05:07 user nova-compute[75260]:   </sysinfo>
Nov 27 05:05:07 user nova-compute[75260]:   <os>
Nov 27 05:05:07 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:05:07 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:05:07 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:05:07 user nova-compute[75260]:   </os>
Nov 27 05:05:07 user nova-compute[75260]:   <features>
Nov 27 05:05:07 user nova-compute[75260]:     <acpi/>
Nov 27 05:05:07 user nova-compute[75260]:     <apic/>
Nov 27 05:05:07 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:05:07 user nova-compute[75260]:   </features>
Nov 27 05:05:07 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:05:07 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:05:07 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:05:07 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:05:07 user nova-compute[75260]:   </clock>
Nov 27 05:05:07 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:05:07 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:05:07 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:05:07 user nova-compute[75260]:   </cpu>
Nov 27 05:05:07 user nova-compute[75260]:   <devices>
Nov 27 05:05:07 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 05:05:07 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 05:05:07 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk"/>
Nov 27 05:05:07 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:05:07 user nova-compute[75260]:     </disk>
Nov 27 05:05:07 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:05:07 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:05:07 user nova-compute[75260]:       <source dev="/dev/sdc"/>
Nov 27 05:05:07 user nova-compute[75260]:       <target dev="vdb" bus="virtio"/>
Nov 27 05:05:07 user nova-compute[75260]:       <serial>4a2f1d7f-0de6-4670-a069-a1dbc7c99a64</serial>
Nov 27 05:05:07 user nova-compute[75260]:     </disk>
Nov 27 05:05:07 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:05:07 user nova-compute[75260]:       <mac address="fa:16:3e:44:e4:f8"/>
Nov 27 05:05:07 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:05:07 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:05:07 user nova-compute[75260]:       <target dev="tapcaaf84bc-70"/>
Nov 27 05:05:07 user nova-compute[75260]:     </interface>
Nov 27 05:05:07 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:05:07 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/console.log" append="off"/>
Nov 27 05:05:07 user nova-compute[75260]:     </serial>
Nov 27 05:05:07 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:05:07 user nova-compute[75260]:     <video>
Nov 27 05:05:07 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:05:07 user nova-compute[75260]:     </video>
Nov 27 05:05:07 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:05:07 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:05:07 user nova-compute[75260]:     </rng>
Nov 27 05:05:07 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:05:07 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:05:07 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:05:07 user nova-compute[75260]:     </memballoon>
Nov 27 05:05:07 user nova-compute[75260]:   </devices>
Nov 27 05:05:07 user nova-compute[75260]: </domain>
Nov 27 05:05:07 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1a25081f-79d1-412f-bf99-4235516d40a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 25fc2351-09a3-4d9f-83b7-485677fa8caf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance dc56ef1d-a722-4c3d-9d24-b7233d18018c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing inventories for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'trusted_certs' on Instance uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating ProviderTree inventory for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.objects.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Object Instance<dc56ef1d-a722-4c3d-9d24-b7233d18018c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing aggregate associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, aggregates: None {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing trait associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1 --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Cannot resize image /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'migration_context' on Instance uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.objects.base [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Object Instance<dc56ef1d-a722-4c3d-9d24-b7233d18018c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-693034548',display_name='tempest-TestMinimumBasicScenario-server-693034548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-693034548',id=43,image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU2zN3v9oVCiggBA5zHD8JmoZleg+rDjqNxhjG4l1CzZldqjmA/+FDQYVcFjRfjYVF7IVddPZ6X7/dbN3Vp3r6Rl3gM0ey358L9QSrG80I2HFLoYJV6FdEaOHxVFljKXg==',key_name='tempest-TestMinimumBasicScenario-494858082',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1fc3728cb2564827a26f40cbc0ec6b5f',ramdisk_id='',reservation_id='r-1pgqw0l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-372834875',owner_user_name='tempest-TestMinimumBasicScenario-372834875-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:05:05Z,user_data=None,user_id='e509f168517f4fef82ce3d34122fd59d',uuid=dc56ef1d-a722-4c3d-9d24-b7233d18018c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converting VIF {"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG os_vif [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.909s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fb388fe-964f-5d08-a79d-30100167cdc5', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcaaf84bc-70, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcaaf84bc-70, col_values=(('qos', UUID('67ee1b2d-94f3-41f6-90bf-83d395945f41')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcaaf84bc-70, col_values=(('external_ids', {'iface-id': 'caaf84bc-7039-4868-99b4-391387bd4a1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:e4:f8', 'vm-uuid': 'dc56ef1d-a722-4c3d-9d24-b7233d18018c'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:05:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:08 user nova-compute[75260]: INFO os_vif [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70')
Nov 27 05:05:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:10 user nova-compute[75260]: DEBUG nova.compute.manager [req-bc8a2422-3a69-4fac-991c-7cef6884f24b req-65998b2a-0cb4-4f86-acd5-fdcaafbaf74a service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bc8a2422-3a69-4fac-991c-7cef6884f24b req-65998b2a-0cb4-4f86-acd5-fdcaafbaf74a service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bc8a2422-3a69-4fac-991c-7cef6884f24b req-65998b2a-0cb4-4f86-acd5-fdcaafbaf74a service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bc8a2422-3a69-4fac-991c-7cef6884f24b req-65998b2a-0cb4-4f86-acd5-fdcaafbaf74a service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:10 user nova-compute[75260]: DEBUG nova.compute.manager [req-bc8a2422-3a69-4fac-991c-7cef6884f24b req-65998b2a-0cb4-4f86-acd5-fdcaafbaf74a service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:05:10 user nova-compute[75260]: WARNING nova.compute.manager [req-bc8a2422-3a69-4fac-991c-7cef6884f24b req-65998b2a-0cb4-4f86-acd5-fdcaafbaf74a service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state active and task_state reboot_started_hard.
Nov 27 05:05:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:11 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:11 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 05:05:11 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:05:11 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] There are 0 instances to clean {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 05:05:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:11 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:05:11 user nova-compute[75260]: INFO nova.compute.claims [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Claim successful on node user
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:05:12 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Instance rebooted successfully.
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-e56328fc-f61e-4450-834c-ad7296e3c833 req-a1d93e00-c9e8-40e5-849e-4549c9ba68e3 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e56328fc-f61e-4450-834c-ad7296e3c833 req-a1d93e00-c9e8-40e5-849e-4549c9ba68e3 service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e56328fc-f61e-4450-834c-ad7296e3c833 req-a1d93e00-c9e8-40e5-849e-4549c9ba68e3 service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e56328fc-f61e-4450-834c-ad7296e3c833 req-a1d93e00-c9e8-40e5-849e-4549c9ba68e3 service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.compute.manager [req-e56328fc-f61e-4450-834c-ad7296e3c833 req-a1d93e00-c9e8-40e5-849e-4549c9ba68e3 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:05:12 user nova-compute[75260]: WARNING nova.compute.manager [req-e56328fc-f61e-4450-834c-ad7296e3c833 req-a1d93e00-c9e8-40e5-849e-4549c9ba68e3 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state active and task_state reboot_started_hard.
Nov 27 05:05:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-05aaa56d-c3b8-4eb4-9b8d-e061b61506d8 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.262s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:05:12 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:05:12 user nova-compute[75260]: INFO nova.virt.block_device [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Booting with volume snapshot 13bea0da-397c-479e-82d1-29178d0e45e0 at /dev/vda
Nov 27 05:05:12 user nova-compute[75260]: DEBUG nova.policy [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bbd9c9317ac4d34ad23932bb35bcc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b302e83cda4b6bacc8e613016c8189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:05:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:13 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Successfully created port: 2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Successfully updated port: 2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "refresh_cache-acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquired lock "refresh_cache-acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-22beaa42-f90b-432c-afa8-add36c57cc27 req-f829c3ba-4997-4ca2-8416-2a8484625f14 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Received event network-changed-2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG nova.compute.manager [req-22beaa42-f90b-432c-afa8-add36c57cc27 req-f829c3ba-4997-4ca2-8416-2a8484625f14 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Refreshing instance network info cache due to event network-changed-2e15b159-9ebe-430d-a5b9-0425752221dc. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-22beaa42-f90b-432c-afa8-add36c57cc27 req-f829c3ba-4997-4ca2-8416-2a8484625f14 service nova] Acquiring lock "refresh_cache-acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG nova.network.neutron [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Updating instance_info_cache with network_info: [{"id": "2e15b159-9ebe-430d-a5b9-0425752221dc", "address": "fa:16:3e:fe:3a:4b", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e15b159-9e", "ovs_interfaceid": "2e15b159-9ebe-430d-a5b9-0425752221dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Releasing lock "refresh_cache-acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Instance network_info: |[{"id": "2e15b159-9ebe-430d-a5b9-0425752221dc", "address": "fa:16:3e:fe:3a:4b", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e15b159-9e", "ovs_interfaceid": "2e15b159-9ebe-430d-a5b9-0425752221dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-22beaa42-f90b-432c-afa8-add36c57cc27 req-f829c3ba-4997-4ca2-8416-2a8484625f14 service nova] Acquired lock "refresh_cache-acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG nova.network.neutron [req-22beaa42-f90b-432c-afa8-add36c57cc27 req-f829c3ba-4997-4ca2-8416-2a8484625f14 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Refreshing network info cache for port 2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75260) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 05:05:15 user nova-compute[75260]: DEBUG nova.network.neutron [req-22beaa42-f90b-432c-afa8-add36c57cc27 req-f829c3ba-4997-4ca2-8416-2a8484625f14 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Updated VIF entry in instance network info cache for port 2e15b159-9ebe-430d-a5b9-0425752221dc. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:05:15 user nova-compute[75260]: DEBUG nova.network.neutron [req-22beaa42-f90b-432c-afa8-add36c57cc27 req-f829c3ba-4997-4ca2-8416-2a8484625f14 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Updating instance_info_cache with network_info: [{"id": "2e15b159-9ebe-430d-a5b9-0425752221dc", "address": "fa:16:3e:fe:3a:4b", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e15b159-9e", "ovs_interfaceid": "2e15b159-9ebe-430d-a5b9-0425752221dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:05:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-22beaa42-f90b-432c-afa8-add36c57cc27 req-f829c3ba-4997-4ca2-8416-2a8484625f14 service nova] Releasing lock "refresh_cache-acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:05:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG os_brick.utils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9560a1eb-cbe6-40e7-94c1-e8468124bef7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[02edf4e2-c529-4ed0-a71a-a3c3b31e9e1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aecf4c-08c7-474e-9301-6fde7907a1b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b789b12-4308-41e9-8275-523fca0d6cd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:05:18 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd09ba38-f96d-42c7-8624-00c297a70604]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG os_brick.utils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Updating existing volume attachment record: b330a3c6-a7de-4c43-ada9-2c93af3fc71e {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:18 user nova-compute[75260]: WARNING nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Nov 27 05:05:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 1a25081f-79d1-412f-bf99-4235516d40a6 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid 25fc2351-09a3-4d9f-83b7-485677fa8caf {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "1a25081f-79d1-412f-bf99-4235516d40a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "1a25081f-79d1-412f-bf99-4235516d40a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "1a25081f-79d1-412f-bf99-4235516d40a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:21 user nova-compute[75260]: INFO nova.compute.manager [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Terminating instance
Nov 27 05:05:21 user nova-compute[75260]: DEBUG nova.compute.manager [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:05:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-4cb2cae5-36da-463c-b537-e61aa5ac628d req-2c3f3dfc-c849-40dd-a176-6a9b476b9879 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received event network-vif-unplugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4cb2cae5-36da-463c-b537-e61aa5ac628d req-2c3f3dfc-c849-40dd-a176-6a9b476b9879 service nova] Acquiring lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4cb2cae5-36da-463c-b537-e61aa5ac628d req-2c3f3dfc-c849-40dd-a176-6a9b476b9879 service nova] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4cb2cae5-36da-463c-b537-e61aa5ac628d req-2c3f3dfc-c849-40dd-a176-6a9b476b9879 service nova] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-4cb2cae5-36da-463c-b537-e61aa5ac628d req-2c3f3dfc-c849-40dd-a176-6a9b476b9879 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] No waiting events found dispatching network-vif-unplugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-4cb2cae5-36da-463c-b537-e61aa5ac628d req-2c3f3dfc-c849-40dd-a176-6a9b476b9879 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received event network-vif-unplugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:05:22 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Instance destroyed successfully.
Nov 27 05:05:22 user nova-compute[75260]: DEBUG nova.objects.instance [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lazy-loading 'resources' on Instance uuid 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1019194683',display_name='tempest-ServerActionsTestOtherA-server-1019194683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1019194683',id=24,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOij+0g1QbUNojcJl3yIM3Tv96IeOdvkNKm5ThbXwXoQhcjwE76rap7fFhOUAjRiN20jCHkXP7XPhGl+HzdyShkrkNHzkMrulgl7gxlMCqAAOAl9YSxm9bSuYOmPOCmkIw==',key_name='tempest-keypair-1643056830',keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a344ddbabc8e48e9987d8aa73042821a',ramdisk_id='',reservation_id='r-cjyd2qz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-678795315',owner_user_name='tempest-ServerActionsTestOtherA-678795315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71baa1a857c5458ea2d03515ea2ccaf3',uuid=3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converting VIF {"id": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "address": "fa:16:3e:7d:50:d8", "network": {"id": "9d9e3660-baa6-425d-9048-c05d03bcf733", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1806040890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a344ddbabc8e48e9987d8aa73042821a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8daac-ec", "ovs_interfaceid": "4fe8daac-ecc6-4b5c-99d6-b651e3c37e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=4fe8daac-ecc6-4b5c-99d6-b651e3c37e82,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8daac-ec') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG os_vif [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=4fe8daac-ecc6-4b5c-99d6-b651e3c37e82,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8daac-ec') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fe8daac-ec, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=360fa416-cdd0-4e75-b8d4-2698333e8444) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:05:22 user nova-compute[75260]: INFO os_vif [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:50:d8,bridge_name='br-int',has_traffic_filtering=True,id=4fe8daac-ecc6-4b5c-99d6-b651e3c37e82,network=Network(9d9e3660-baa6-425d-9048-c05d03bcf733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8daac-ec')
Nov 27 05:05:22 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Deleting instance files /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf_del
Nov 27 05:05:22 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Deletion of /opt/stack/data/nova/instances/3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf_del complete
Nov 27 05:05:22 user nova-compute[75260]: INFO nova.compute.manager [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 27 05:05:22 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:05:22 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:05:23 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:05:23 user nova-compute[75260]: DEBUG nova.compute.manager [req-9c773a47-8616-4f9c-b315-69037f6dc03c req-f72ddf0d-7a0b-43fc-a7fa-519ef48087c2 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received event network-vif-deleted-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:23 user nova-compute[75260]: INFO nova.compute.manager [req-9c773a47-8616-4f9c-b315-69037f6dc03c req-f72ddf0d-7a0b-43fc-a7fa-519ef48087c2 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Neutron deleted interface 4fe8daac-ecc6-4b5c-99d6-b651e3c37e82; detaching it from the instance and deleting it from the info cache
Nov 27 05:05:23 user nova-compute[75260]: DEBUG nova.network.neutron [req-9c773a47-8616-4f9c-b315-69037f6dc03c req-f72ddf0d-7a0b-43fc-a7fa-519ef48087c2 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:05:23 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Took 0.47 seconds to deallocate network for instance.
Nov 27 05:05:23 user nova-compute[75260]: DEBUG nova.compute.manager [req-9c773a47-8616-4f9c-b315-69037f6dc03c req-f72ddf0d-7a0b-43fc-a7fa-519ef48087c2 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Detach interface failed, port_id=4fe8daac-ecc6-4b5c-99d6-b651e3c37e82, reason: Instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 05:05:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:23 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:05:23 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:05:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:23 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Deleted allocations for instance 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf
Nov 27 05:05:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-065cd1d8-c0bd-41b5-838c-567c26a098ea tempest-ServerActionsTestOtherA-678795315 tempest-ServerActionsTestOtherA-678795315-project-member] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.910s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-5cbb794d-d1ca-4d4d-894d-f62084c6d255 req-247b0eeb-a255-42ca-81f5-a43ea095dec6 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received event network-vif-plugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5cbb794d-d1ca-4d4d-894d-f62084c6d255 req-247b0eeb-a255-42ca-81f5-a43ea095dec6 service nova] Acquiring lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5cbb794d-d1ca-4d4d-894d-f62084c6d255 req-247b0eeb-a255-42ca-81f5-a43ea095dec6 service nova] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5cbb794d-d1ca-4d4d-894d-f62084c6d255 req-247b0eeb-a255-42ca-81f5-a43ea095dec6 service nova] Lock "3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-5cbb794d-d1ca-4d4d-894d-f62084c6d255 req-247b0eeb-a255-42ca-81f5-a43ea095dec6 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] No waiting events found dispatching network-vif-plugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:05:24 user nova-compute[75260]: WARNING nova.compute.manager [req-5cbb794d-d1ca-4d4d-894d-f62084c6d255 req-247b0eeb-a255-42ca-81f5-a43ea095dec6 service nova] [instance: 3d8a761b-fbcc-4ac1-a38a-379d9fce3dcf] Received unexpected event network-vif-plugged-4fe8daac-ecc6-4b5c-99d6-b651e3c37e82 for instance with vm_state deleted and task_state None.
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:05:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Creating image(s)
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Ensure instance console log exists: /opt/stack/data/nova/instances/acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Start _get_guest_xml network_info=[{"id": "2e15b159-9ebe-430d-a5b9-0425752221dc", "address": "fa:16:3e:fe:3a:4b", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e15b159-9e", "ovs_interfaceid": "2e15b159-9ebe-430d-a5b9-0425752221dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'b330a3c6-a7de-4c43-ada9-2c93af3fc71e', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKfcbDTx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484', 'attached_at': '', 'detached_at': '', 'volume_id': '6d82be5e-611b-42b7-b8f7-9fe15d61c7d0', 'serial': '6d82be5e-611b-42b7-b8f7-9fe15d61c7d0'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:05:25 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:05:25 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKfcbDTx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:05:25 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:05:25 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:05:25 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c8b3ef-6e60-4577-b89b-2543c2241f70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:05:25 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71fa1fe-e16a-42ed-b640-e34ae4b1f6eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0] added
Nov 27 05:05:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce41a546-5b7f-46d0-bf25-2b019f6468c0]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbe60c9-7fa2-4b53-b33c-8c9aad263d01]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKfcbDTx {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKfcbDTx" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14668df-293f-4fa7-9403-f23ae6da7226]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JKfcbDTx'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a1173e-80ba-491c-a7cb-fe085076af50]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb20ce24-cd95-4789-8921-2c0c8dd4f347]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:25 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:25 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:05:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:25 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:25 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:05:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e1c5b0-f13e-4d2d-a768-0f50a02e4b27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0, portal: 172.16.0.220,3260]
Nov 27 05:05:25 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0, portal: 172.16.0.220,3260] successful.
Nov 27 05:05:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f139ce04-e128-4636-94ca-db8d11c03864]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[32455802-a924-4e9b-9a83-3392d7b4b960]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:25 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:25 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:05:25 user nova-compute[75260]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 (non-flash)
Nov 27 05:05:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:25 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:25 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:05:25 user nova-compute[75260]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 (non-flash)
Nov 27 05:05:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4726d4d7-4fbc-42d8-830e-e74687a4f9d4]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:05:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKfcbDTx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26434613562666636', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434613562666636', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1899630999',display_name='tempest-TestVolumeBootPattern-server-1899630999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1899630999',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-1piut5k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:05:13Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e15b159-9ebe-430d-a5b9-0425752221dc", "address": "fa:16:3e:fe:3a:4b", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e15b159-9e", "ovs_interfaceid": "2e15b159-9ebe-430d-a5b9-0425752221dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "2e15b159-9ebe-430d-a5b9-0425752221dc", "address": "fa:16:3e:fe:3a:4b", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e15b159-9e", "ovs_interfaceid": "2e15b159-9ebe-430d-a5b9-0425752221dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:3a:4b,bridge_name='br-int',has_traffic_filtering=True,id=2e15b159-9ebe-430d-a5b9-0425752221dc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e15b159-9e') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.objects.instance [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'pci_devices' on Instance uuid acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:05:26 user nova-compute[75260]:   <uuid>acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484</uuid>
Nov 27 05:05:26 user nova-compute[75260]:   <name>instance-0000002c</name>
Nov 27 05:05:26 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:05:26 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:05:26 user nova-compute[75260]:   <metadata>
Nov 27 05:05:26 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:05:26 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:05:26 user nova-compute[75260]:       <nova:name>tempest-TestVolumeBootPattern-server-1899630999</nova:name>
Nov 27 05:05:26 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:05:25</nova:creationTime>
Nov 27 05:05:26 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:05:26 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:05:26 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:05:26 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:05:26 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:05:26 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:05:26 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:05:26 user nova-compute[75260]:       <nova:owner>
Nov 27 05:05:26 user nova-compute[75260]:         <nova:user uuid="5bbd9c9317ac4d34ad23932bb35bcc87">tempest-TestVolumeBootPattern-1806325901-project-member</nova:user>
Nov 27 05:05:26 user nova-compute[75260]:         <nova:project uuid="c4b302e83cda4b6bacc8e613016c8189">tempest-TestVolumeBootPattern-1806325901</nova:project>
Nov 27 05:05:26 user nova-compute[75260]:       </nova:owner>
Nov 27 05:05:26 user nova-compute[75260]:       <nova:ports>
Nov 27 05:05:26 user nova-compute[75260]:         <nova:port uuid="2e15b159-9ebe-430d-a5b9-0425752221dc">
Nov 27 05:05:26 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 05:05:26 user nova-compute[75260]:         </nova:port>
Nov 27 05:05:26 user nova-compute[75260]:       </nova:ports>
Nov 27 05:05:26 user nova-compute[75260]:     </nova:instance>
Nov 27 05:05:26 user nova-compute[75260]:   </metadata>
Nov 27 05:05:26 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:05:26 user nova-compute[75260]:     <system>
Nov 27 05:05:26 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:05:26 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:05:26 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:05:26 user nova-compute[75260]:       <entry name="serial">acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484</entry>
Nov 27 05:05:26 user nova-compute[75260]:       <entry name="uuid">acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484</entry>
Nov 27 05:05:26 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:05:26 user nova-compute[75260]:     </system>
Nov 27 05:05:26 user nova-compute[75260]:   </sysinfo>
Nov 27 05:05:26 user nova-compute[75260]:   <os>
Nov 27 05:05:26 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:05:26 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:05:26 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:05:26 user nova-compute[75260]:   </os>
Nov 27 05:05:26 user nova-compute[75260]:   <features>
Nov 27 05:05:26 user nova-compute[75260]:     <acpi/>
Nov 27 05:05:26 user nova-compute[75260]:     <apic/>
Nov 27 05:05:26 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:05:26 user nova-compute[75260]:   </features>
Nov 27 05:05:26 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:05:26 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:05:26 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:05:26 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:05:26 user nova-compute[75260]:   </clock>
Nov 27 05:05:26 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:05:26 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:05:26 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:05:26 user nova-compute[75260]:   </cpu>
Nov 27 05:05:26 user nova-compute[75260]:   <devices>
Nov 27 05:05:26 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:05:26 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:05:26 user nova-compute[75260]:       <source dev="/dev/sdd"/>
Nov 27 05:05:26 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:05:26 user nova-compute[75260]:       <serial>6d82be5e-611b-42b7-b8f7-9fe15d61c7d0</serial>
Nov 27 05:05:26 user nova-compute[75260]:     </disk>
Nov 27 05:05:26 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:05:26 user nova-compute[75260]:       <mac address="fa:16:3e:fe:3a:4b"/>
Nov 27 05:05:26 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:05:26 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:05:26 user nova-compute[75260]:       <target dev="tap2e15b159-9e"/>
Nov 27 05:05:26 user nova-compute[75260]:     </interface>
Nov 27 05:05:26 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:05:26 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484/console.log" append="off"/>
Nov 27 05:05:26 user nova-compute[75260]:     </serial>
Nov 27 05:05:26 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:05:26 user nova-compute[75260]:     <video>
Nov 27 05:05:26 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:05:26 user nova-compute[75260]:     </video>
Nov 27 05:05:26 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:05:26 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:05:26 user nova-compute[75260]:     </rng>
Nov 27 05:05:26 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:05:26 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:05:26 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:05:26 user nova-compute[75260]:     </memballoon>
Nov 27 05:05:26 user nova-compute[75260]:   </devices>
Nov 27 05:05:26 user nova-compute[75260]: </domain>
Nov 27 05:05:26 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1899630999',display_name='tempest-TestVolumeBootPattern-server-1899630999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1899630999',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-1piut5k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:05:13Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e15b159-9ebe-430d-a5b9-0425752221dc", "address": "fa:16:3e:fe:3a:4b", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e15b159-9e", "ovs_interfaceid": "2e15b159-9ebe-430d-a5b9-0425752221dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "2e15b159-9ebe-430d-a5b9-0425752221dc", "address": "fa:16:3e:fe:3a:4b", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e15b159-9e", "ovs_interfaceid": "2e15b159-9ebe-430d-a5b9-0425752221dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:3a:4b,bridge_name='br-int',has_traffic_filtering=True,id=2e15b159-9ebe-430d-a5b9-0425752221dc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e15b159-9e') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG os_vif [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:3a:4b,bridge_name='br-int',has_traffic_filtering=True,id=2e15b159-9ebe-430d-a5b9-0425752221dc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e15b159-9e') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4da98106-d24d-5b69-b355-08823eae0d61', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e15b159-9e, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e15b159-9e, col_values=(('qos', UUID('e5f397a3-b8a3-4582-9bc9-267f38895e64')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e15b159-9e, col_values=(('external_ids', {'iface-id': '2e15b159-9ebe-430d-a5b9-0425752221dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:3a:4b', 'vm-uuid': 'acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:26 user nova-compute[75260]: INFO os_vif [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:3a:4b,bridge_name='br-int',has_traffic_filtering=True,id=2e15b159-9ebe-430d-a5b9-0425752221dc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e15b159-9e')
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:05:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No VIF found with MAC fa:16:3e:fe:3a:4b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:05:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-2bfbbd5d-0ccd-4559-87ca-022902d303c6 req-c066ba27-a155-49af-91f8-3f3f706e3c3c service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Received event network-vif-plugged-2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2bfbbd5d-0ccd-4559-87ca-022902d303c6 req-c066ba27-a155-49af-91f8-3f3f706e3c3c service nova] Acquiring lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2bfbbd5d-0ccd-4559-87ca-022902d303c6 req-c066ba27-a155-49af-91f8-3f3f706e3c3c service nova] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2bfbbd5d-0ccd-4559-87ca-022902d303c6 req-c066ba27-a155-49af-91f8-3f3f706e3c3c service nova] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-2bfbbd5d-0ccd-4559-87ca-022902d303c6 req-c066ba27-a155-49af-91f8-3f3f706e3c3c service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] No waiting events found dispatching network-vif-plugged-2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:05:28 user nova-compute[75260]: WARNING nova.compute.manager [req-2bfbbd5d-0ccd-4559-87ca-022902d303c6 req-c066ba27-a155-49af-91f8-3f3f706e3c3c service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Received unexpected event network-vif-plugged-2e15b159-9ebe-430d-a5b9-0425752221dc for instance with vm_state building and task_state spawning.
Nov 27 05:05:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-577f6057-308f-4ad4-a341-c812ea42cde5 req-fce91d4b-991f-44da-8b55-12c9de6938a4 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Received event network-vif-plugged-2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-577f6057-308f-4ad4-a341-c812ea42cde5 req-fce91d4b-991f-44da-8b55-12c9de6938a4 service nova] Acquiring lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-577f6057-308f-4ad4-a341-c812ea42cde5 req-fce91d4b-991f-44da-8b55-12c9de6938a4 service nova] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-577f6057-308f-4ad4-a341-c812ea42cde5 req-fce91d4b-991f-44da-8b55-12c9de6938a4 service nova] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-577f6057-308f-4ad4-a341-c812ea42cde5 req-fce91d4b-991f-44da-8b55-12c9de6938a4 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] No waiting events found dispatching network-vif-plugged-2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:05:30 user nova-compute[75260]: WARNING nova.compute.manager [req-577f6057-308f-4ad4-a341-c812ea42cde5 req-fce91d4b-991f-44da-8b55-12c9de6938a4 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Received unexpected event network-vif-plugged-2e15b159-9ebe-430d-a5b9-0425752221dc for instance with vm_state building and task_state spawning.
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:05:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Instance spawned successfully.
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:05:30 user nova-compute[75260]: INFO nova.compute.manager [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 27 05:05:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:05:30 user nova-compute[75260]: INFO nova.compute.manager [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Took 18.57 seconds to build instance.
Nov 27 05:05:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-7e7bc8a8-342e-4faf-aefe-b0fc2926270b tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.663s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.703s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:30 user nova-compute[75260]: INFO nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 27 05:05:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:46 user nova-compute[75260]: INFO nova.compute.manager [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Terminating instance
Nov 27 05:05:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-9d6612a4-da4d-40f9-896f-6e8911b0f75d req-c360114e-b640-416b-b1eb-d382364665ce service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-unplugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9d6612a4-da4d-40f9-896f-6e8911b0f75d req-c360114e-b640-416b-b1eb-d382364665ce service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9d6612a4-da4d-40f9-896f-6e8911b0f75d req-c360114e-b640-416b-b1eb-d382364665ce service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9d6612a4-da4d-40f9-896f-6e8911b0f75d req-c360114e-b640-416b-b1eb-d382364665ce service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-9d6612a4-da4d-40f9-896f-6e8911b0f75d req-c360114e-b640-416b-b1eb-d382364665ce service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-unplugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-9d6612a4-da4d-40f9-896f-6e8911b0f75d req-c360114e-b640-416b-b1eb-d382364665ce service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-unplugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:47 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Instance destroyed successfully.
Nov 27 05:05:47 user nova-compute[75260]: DEBUG nova.objects.instance [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'resources' on Instance uuid 25fc2351-09a3-4d9f-83b7-485677fa8caf {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-473047943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-473047943',id=42,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:02:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-buyu0ef7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:04:00Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=25fc2351-09a3-4d9f-83b7-485677fa8caf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "address": "fa:16:3e:ee:ca:01", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf4036b-0b", "ovs_interfaceid": "fbf4036b-0b1f-43b1-8bb0-a612d17b6eed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:ca:01,bridge_name='br-int',has_traffic_filtering=True,id=fbf4036b-0b1f-43b1-8bb0-a612d17b6eed,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf4036b-0b') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_vif [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:ca:01,bridge_name='br-int',has_traffic_filtering=True,id=fbf4036b-0b1f-43b1-8bb0-a612d17b6eed,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf4036b-0b') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbf4036b-0b, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5319699f-2cdc-4526-a336-72189c4ee015) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:05:47 user nova-compute[75260]: INFO os_vif [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:ca:01,bridge_name='br-int',has_traffic_filtering=True,id=fbf4036b-0b1f-43b1-8bb0-a612d17b6eed,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf4036b-0b')
Nov 27 05:05:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqnuVtHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:05:47 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bfea39-dce2-40ae-87e0-af62f15a4a0d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:05:47 user nova-compute[75260]: No targets found.
Nov 27 05:05:47 user nova-compute[75260]: iSNS:
Nov 27 05:05:47 user nova-compute[75260]: No targets found.
Nov 27 05:05:47 user nova-compute[75260]: STATIC:
Nov 27 05:05:47 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64
Nov 27 05:05:47 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:05:47 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:05:47 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:05:47 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:05:47 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:05:47 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0
Nov 27 05:05:47 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:05:47 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:05:47 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69
Nov 27 05:05:47 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:05:47 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:05:47 user nova-compute[75260]: FIRMWARE:
Nov 27 05:05:47 user nova-compute[75260]: No targets found.
Nov 27 05:05:47 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:05:47 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:05:47 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf113d09-1947-4dc6-b3f1-5967928e3178]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f12daa-8532-4956-99d4-bb5c38b36ff5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:47 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:47 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:05:47 user nova-compute[75260]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 (non-flash)
Nov 27 05:05:47 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:05:47 user nova-compute[75260]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 (non-flash)
Nov 27 05:05:47 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:05:47 user nova-compute[75260]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 (non-flash)
Nov 27 05:05:47 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb544632e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[38daf6f0-33fb-47a6-9037-28295f49608b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[56967e7e-bb41-48de-8d8b-05fe26f02c9d]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c15f1d-bd18-4a3c-83a6-019cdfd477e2]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b9f95a-9531-4989-8055-ae4829706aee]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4974a41b-ccab-4b9f-8143-dc91db08e90e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63877eb-0998-4936-b9ae-661c7669377e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69, portal: 172.16.0.220,3260]
Nov 27 05:05:47 user nova-compute[75260]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69, portal: 172.16.0.220,3260] successful.
Nov 27 05:05:47 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a94b53a7-5ce0-4595-a1d2-343ab4232e69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[40805d0a-2638-43f1-9e64-e5fa8d12f9ae]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] <== disconnect_volume: return (351ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:05:47 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Deleting instance files /opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf_del
Nov 27 05:05:47 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Deletion of /opt/stack/data/nova/instances/25fc2351-09a3-4d9f-83b7-485677fa8caf_del complete
Nov 27 05:05:47 user nova-compute[75260]: INFO nova.compute.manager [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 27 05:05:47 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:05:47 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:05:48 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:05:48 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Took 0.47 seconds to deallocate network for instance.
Nov 27 05:05:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-34a9739f-3e16-4be9-a917-6f7b235b0be8 req-f473abbc-97d0-4090-83b3-87cadb1513e4 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-34a9739f-3e16-4be9-a917-6f7b235b0be8 req-f473abbc-97d0-4090-83b3-87cadb1513e4 service nova] Acquiring lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-34a9739f-3e16-4be9-a917-6f7b235b0be8 req-f473abbc-97d0-4090-83b3-87cadb1513e4 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-34a9739f-3e16-4be9-a917-6f7b235b0be8 req-f473abbc-97d0-4090-83b3-87cadb1513e4 service nova] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-34a9739f-3e16-4be9-a917-6f7b235b0be8 req-f473abbc-97d0-4090-83b3-87cadb1513e4 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] No waiting events found dispatching network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:05:48 user nova-compute[75260]: WARNING nova.compute.manager [req-34a9739f-3e16-4be9-a917-6f7b235b0be8 req-f473abbc-97d0-4090-83b3-87cadb1513e4 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received unexpected event network-vif-plugged-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed for instance with vm_state active and task_state deleting.
Nov 27 05:05:48 user nova-compute[75260]: DEBUG nova.compute.manager [req-34a9739f-3e16-4be9-a917-6f7b235b0be8 req-f473abbc-97d0-4090-83b3-87cadb1513e4 service nova] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Received event network-vif-deleted-fbf4036b-0b1f-43b1-8bb0-a612d17b6eed {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:05:48 user nova-compute[75260]: INFO nova.compute.manager [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 25fc2351-09a3-4d9f-83b7-485677fa8caf] Took 0.87 seconds to detach 1 volumes for instance.
Nov 27 05:05:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:05:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:05:49 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:05:49 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:05:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:49 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Deleted allocations for instance 25fc2351-09a3-4d9f-83b7-485677fa8caf
Nov 27 05:05:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-aa408770-7d3e-4009-bc0b-2af653e6be90 tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "25fc2351-09a3-4d9f-83b7-485677fa8caf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.958s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:05:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:05:58 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:05:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:06:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:06:00 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:06:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:06:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 05:06:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:06:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:06:00 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:06:00 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:06:01 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Updating instance_info_cache with network_info: [{"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:06:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-1b25e35f-08c6-46e6-8dd4-4a50a2028c33" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:06:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:06:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:06:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:06:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:06:05 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:06:06 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:06:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:08 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:06:08 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8420MB free_disk=25.020225524902344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1a25081f-79d1-412f-bf99-4235516d40a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance dc56ef1d-a722-4c3d-9d24-b7233d18018c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:06:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:06:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:06:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:06:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:06:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:06:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:24 user nova-compute[75260]: DEBUG nova.compute.manager [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:06:25 user nova-compute[75260]: INFO nova.compute.claims [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Claim successful on node user
Nov 27 05:06:25 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG nova.network.neutron [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:06:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:06:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG nova.policy [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bfa8522667f4592bc4bfb0712b6b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ba48818d9d412da1471e0f56125dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:06:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Creating image(s)
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "/opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "/opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk 1073741824" returned: 0 in 0.057s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG nova.network.neutron [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Successfully created port: 3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Cannot resize image /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Ensure instance console log exists: /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG nova.network.neutron [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Successfully updated port: 3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquired lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG nova.network.neutron [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-dab30cb7-7ad8-4afc-8b93-d94b846a2e4e req-76b70379-8d6c-425f-bd7e-9023bcd364cd service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-changed-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-dab30cb7-7ad8-4afc-8b93-d94b846a2e4e req-76b70379-8d6c-425f-bd7e-9023bcd364cd service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Refreshing instance network info cache due to event network-changed-3a757f70-bf6a-4b7b-b62c-adc9c158836f. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-dab30cb7-7ad8-4afc-8b93-d94b846a2e4e req-76b70379-8d6c-425f-bd7e-9023bcd364cd service nova] Acquiring lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:06:26 user nova-compute[75260]: DEBUG nova.network.neutron [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.network.neutron [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updating instance_info_cache with network_info: [{"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Releasing lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Instance network_info: |[{"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-dab30cb7-7ad8-4afc-8b93-d94b846a2e4e req-76b70379-8d6c-425f-bd7e-9023bcd364cd service nova] Acquired lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.network.neutron [req-dab30cb7-7ad8-4afc-8b93-d94b846a2e4e req-76b70379-8d6c-425f-bd7e-9023bcd364cd service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Refreshing network info cache for port 3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Start _get_guest_xml network_info=[{"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:06:27 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:06:27 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662644095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662644095',id=45,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwTee5WzLqQhoRMA4sbX1fAotCAjpFJipUMi3g9gAfLEVR90Y0EtLbqHarpPBhAGLKQlbarxTVB1rw4RYU74yALs0GrJT/AUIoZcxScITh7PRun10sRS4g4yvN5SVkh0A==',key_name='tempest-keypair-730565496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-5ynjblwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=d7e4e399-4234-498c-b87a-9ed75477e2b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.objects.instance [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'pci_devices' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:06:27 user nova-compute[75260]:   <uuid>d7e4e399-4234-498c-b87a-9ed75477e2b6</uuid>
Nov 27 05:06:27 user nova-compute[75260]:   <name>instance-0000002d</name>
Nov 27 05:06:27 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:06:27 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:06:27 user nova-compute[75260]:   <metadata>
Nov 27 05:06:27 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:06:27 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:06:27 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-662644095</nova:name>
Nov 27 05:06:27 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:06:27</nova:creationTime>
Nov 27 05:06:27 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:06:27 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:06:27 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:06:27 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:06:27 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:06:27 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:06:27 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:06:27 user nova-compute[75260]:       <nova:owner>
Nov 27 05:06:27 user nova-compute[75260]:         <nova:user uuid="0bfa8522667f4592bc4bfb0712b6b1f7">tempest-AttachVolumeShelveTestJSON-1008190038-project-member</nova:user>
Nov 27 05:06:27 user nova-compute[75260]:         <nova:project uuid="c1ba48818d9d412da1471e0f56125dec">tempest-AttachVolumeShelveTestJSON-1008190038</nova:project>
Nov 27 05:06:27 user nova-compute[75260]:       </nova:owner>
Nov 27 05:06:27 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 05:06:27 user nova-compute[75260]:       <nova:ports>
Nov 27 05:06:27 user nova-compute[75260]:         <nova:port uuid="3a757f70-bf6a-4b7b-b62c-adc9c158836f">
Nov 27 05:06:27 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 05:06:27 user nova-compute[75260]:         </nova:port>
Nov 27 05:06:27 user nova-compute[75260]:       </nova:ports>
Nov 27 05:06:27 user nova-compute[75260]:     </nova:instance>
Nov 27 05:06:27 user nova-compute[75260]:   </metadata>
Nov 27 05:06:27 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:06:27 user nova-compute[75260]:     <system>
Nov 27 05:06:27 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:06:27 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:06:27 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:06:27 user nova-compute[75260]:       <entry name="serial">d7e4e399-4234-498c-b87a-9ed75477e2b6</entry>
Nov 27 05:06:27 user nova-compute[75260]:       <entry name="uuid">d7e4e399-4234-498c-b87a-9ed75477e2b6</entry>
Nov 27 05:06:27 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:06:27 user nova-compute[75260]:     </system>
Nov 27 05:06:27 user nova-compute[75260]:   </sysinfo>
Nov 27 05:06:27 user nova-compute[75260]:   <os>
Nov 27 05:06:27 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:06:27 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:06:27 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:06:27 user nova-compute[75260]:   </os>
Nov 27 05:06:27 user nova-compute[75260]:   <features>
Nov 27 05:06:27 user nova-compute[75260]:     <acpi/>
Nov 27 05:06:27 user nova-compute[75260]:     <apic/>
Nov 27 05:06:27 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:06:27 user nova-compute[75260]:   </features>
Nov 27 05:06:27 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:06:27 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:06:27 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:06:27 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:06:27 user nova-compute[75260]:   </clock>
Nov 27 05:06:27 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:06:27 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:06:27 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:06:27 user nova-compute[75260]:   </cpu>
Nov 27 05:06:27 user nova-compute[75260]:   <devices>
Nov 27 05:06:27 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 05:06:27 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 05:06:27 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk"/>
Nov 27 05:06:27 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:06:27 user nova-compute[75260]:     </disk>
Nov 27 05:06:27 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:06:27 user nova-compute[75260]:       <mac address="fa:16:3e:30:3a:73"/>
Nov 27 05:06:27 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:06:27 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:06:27 user nova-compute[75260]:       <target dev="tap3a757f70-bf"/>
Nov 27 05:06:27 user nova-compute[75260]:     </interface>
Nov 27 05:06:27 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:06:27 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/console.log" append="off"/>
Nov 27 05:06:27 user nova-compute[75260]:     </serial>
Nov 27 05:06:27 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:06:27 user nova-compute[75260]:     <video>
Nov 27 05:06:27 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:06:27 user nova-compute[75260]:     </video>
Nov 27 05:06:27 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:06:27 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:06:27 user nova-compute[75260]:     </rng>
Nov 27 05:06:27 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:06:27 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:06:27 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:06:27 user nova-compute[75260]:     </memballoon>
Nov 27 05:06:27 user nova-compute[75260]:   </devices>
Nov 27 05:06:27 user nova-compute[75260]: </domain>
Nov 27 05:06:27 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662644095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662644095',id=45,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwTee5WzLqQhoRMA4sbX1fAotCAjpFJipUMi3g9gAfLEVR90Y0EtLbqHarpPBhAGLKQlbarxTVB1rw4RYU74yALs0GrJT/AUIoZcxScITh7PRun10sRS4g4yvN5SVkh0A==',key_name='tempest-keypair-730565496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-5ynjblwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=d7e4e399-4234-498c-b87a-9ed75477e2b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG os_vif [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1de97e41-aacf-5d22-a421-e440d2ff0fde', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a757f70-bf, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a757f70-bf, col_values=(('qos', UUID('275e9cd6-47f2-43b4-97e2-cc7aaa9dc2b8')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a757f70-bf, col_values=(('external_ids', {'iface-id': '3a757f70-bf6a-4b7b-b62c-adc9c158836f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:3a:73', 'vm-uuid': 'd7e4e399-4234-498c-b87a-9ed75477e2b6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:27 user nova-compute[75260]: INFO os_vif [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf')
Nov 27 05:06:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] No VIF found with MAC fa:16:3e:30:3a:73, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.network.neutron [req-dab30cb7-7ad8-4afc-8b93-d94b846a2e4e req-76b70379-8d6c-425f-bd7e-9023bcd364cd service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updated VIF entry in instance network info cache for port 3a757f70-bf6a-4b7b-b62c-adc9c158836f. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG nova.network.neutron [req-dab30cb7-7ad8-4afc-8b93-d94b846a2e4e req-76b70379-8d6c-425f-bd7e-9023bcd364cd service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updating instance_info_cache with network_info: [{"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:06:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-dab30cb7-7ad8-4afc-8b93-d94b846a2e4e req-76b70379-8d6c-425f-bd7e-9023bcd364cd service nova] Releasing lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:06:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-31ee0527-4917-49b7-b05a-29eee7cefa66 req-a0000ab2-c25a-47dc-8a71-90fd8ebb9bf6 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:06:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-31ee0527-4917-49b7-b05a-29eee7cefa66 req-a0000ab2-c25a-47dc-8a71-90fd8ebb9bf6 service nova] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-31ee0527-4917-49b7-b05a-29eee7cefa66 req-a0000ab2-c25a-47dc-8a71-90fd8ebb9bf6 service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-31ee0527-4917-49b7-b05a-29eee7cefa66 req-a0000ab2-c25a-47dc-8a71-90fd8ebb9bf6 service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-31ee0527-4917-49b7-b05a-29eee7cefa66 req-a0000ab2-c25a-47dc-8a71-90fd8ebb9bf6 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] No waiting events found dispatching network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:06:28 user nova-compute[75260]: WARNING nova.compute.manager [req-31ee0527-4917-49b7-b05a-29eee7cefa66 req-a0000ab2-c25a-47dc-8a71-90fd8ebb9bf6 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received unexpected event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f for instance with vm_state building and task_state spawning.
Nov 27 05:06:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:06:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:06:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Instance spawned successfully.
Nov 27 05:06:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:06:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:06:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:06:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:06:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:06:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:06:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:06:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-f245425b-d305-4402-b8af-9eb6326fb4d1 req-18cf6b91-8643-458b-a3d9-86d9f369b1a7 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:06:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f245425b-d305-4402-b8af-9eb6326fb4d1 req-18cf6b91-8643-458b-a3d9-86d9f369b1a7 service nova] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f245425b-d305-4402-b8af-9eb6326fb4d1 req-18cf6b91-8643-458b-a3d9-86d9f369b1a7 service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f245425b-d305-4402-b8af-9eb6326fb4d1 req-18cf6b91-8643-458b-a3d9-86d9f369b1a7 service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-f245425b-d305-4402-b8af-9eb6326fb4d1 req-18cf6b91-8643-458b-a3d9-86d9f369b1a7 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] No waiting events found dispatching network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:06:31 user nova-compute[75260]: WARNING nova.compute.manager [req-f245425b-d305-4402-b8af-9eb6326fb4d1 req-18cf6b91-8643-458b-a3d9-86d9f369b1a7 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received unexpected event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f for instance with vm_state building and task_state spawning.
Nov 27 05:06:31 user nova-compute[75260]: INFO nova.compute.manager [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 27 05:06:31 user nova-compute[75260]: DEBUG nova.compute.manager [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:06:31 user nova-compute[75260]: INFO nova.compute.manager [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Took 6.16 seconds to build instance.
Nov 27 05:06:31 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-afb301ba-f800-4766-9f62-3f7eec29527b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.278s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "1a25081f-79d1-412f-bf99-4235516d40a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1a25081f-79d1-412f-bf99-4235516d40a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:36 user nova-compute[75260]: INFO nova.compute.manager [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Terminating instance
Nov 27 05:06:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:06:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-59798359-8a40-4797-8514-887dc2631e6d req-d3bb2f31-5e41-42e3-beb9-cf7d81bacc90 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Received event network-vif-unplugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-59798359-8a40-4797-8514-887dc2631e6d req-d3bb2f31-5e41-42e3-beb9-cf7d81bacc90 service nova] Acquiring lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-59798359-8a40-4797-8514-887dc2631e6d req-d3bb2f31-5e41-42e3-beb9-cf7d81bacc90 service nova] Lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-59798359-8a40-4797-8514-887dc2631e6d req-d3bb2f31-5e41-42e3-beb9-cf7d81bacc90 service nova] Lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-59798359-8a40-4797-8514-887dc2631e6d req-d3bb2f31-5e41-42e3-beb9-cf7d81bacc90 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] No waiting events found dispatching network-vif-unplugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-59798359-8a40-4797-8514-887dc2631e6d req-d3bb2f31-5e41-42e3-beb9-cf7d81bacc90 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Received event network-vif-unplugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:37 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Instance destroyed successfully.
Nov 27 05:06:37 user nova-compute[75260]: DEBUG nova.objects.instance [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'resources' on Instance uuid 1a25081f-79d1-412f-bf99-4235516d40a6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1130073666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1130073666',id=37,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-pvf4xr21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:59:11Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=1a25081f-79d1-412f-bf99-4235516d40a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "address": "fa:16:3e:be:49:d7", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cb7cdc-1e", "ovs_interfaceid": "36cb7cdc-1e5a-475f-b055-b06a2c0c7a27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:49:d7,bridge_name='br-int',has_traffic_filtering=True,id=36cb7cdc-1e5a-475f-b055-b06a2c0c7a27,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36cb7cdc-1e') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG os_vif [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:49:d7,bridge_name='br-int',has_traffic_filtering=True,id=36cb7cdc-1e5a-475f-b055-b06a2c0c7a27,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36cb7cdc-1e') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36cb7cdc-1e, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bd3e01b-7bdc-4f34-9dba-23703f4aebde) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:37 user nova-compute[75260]: INFO os_vif [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:49:d7,bridge_name='br-int',has_traffic_filtering=True,id=36cb7cdc-1e5a-475f-b055-b06a2c0c7a27,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36cb7cdc-1e')
Nov 27 05:06:37 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Deleting instance files /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6_del
Nov 27 05:06:37 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Deletion of /opt/stack/data/nova/instances/1a25081f-79d1-412f-bf99-4235516d40a6_del complete
Nov 27 05:06:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:37 user nova-compute[75260]: INFO nova.compute.manager [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 27 05:06:37 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:06:37 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Took 0.43 seconds to deallocate network for instance.
Nov 27 05:06:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:38 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:06:38 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:06:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:38 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Deleted allocations for instance 1a25081f-79d1-412f-bf99-4235516d40a6
Nov 27 05:06:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-81e2b34c-a16e-4abc-9f8b-e5780be0382e tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1a25081f-79d1-412f-bf99-4235516d40a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.492s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-d176861c-911c-498f-b7ca-b6d326b485c7 req-cc360168-04bc-4e02-a3ba-57f0f243e146 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Received event network-vif-plugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:06:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d176861c-911c-498f-b7ca-b6d326b485c7 req-cc360168-04bc-4e02-a3ba-57f0f243e146 service nova] Acquiring lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d176861c-911c-498f-b7ca-b6d326b485c7 req-cc360168-04bc-4e02-a3ba-57f0f243e146 service nova] Lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d176861c-911c-498f-b7ca-b6d326b485c7 req-cc360168-04bc-4e02-a3ba-57f0f243e146 service nova] Lock "1a25081f-79d1-412f-bf99-4235516d40a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:06:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-d176861c-911c-498f-b7ca-b6d326b485c7 req-cc360168-04bc-4e02-a3ba-57f0f243e146 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] No waiting events found dispatching network-vif-plugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:06:39 user nova-compute[75260]: WARNING nova.compute.manager [req-d176861c-911c-498f-b7ca-b6d326b485c7 req-cc360168-04bc-4e02-a3ba-57f0f243e146 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Received unexpected event network-vif-plugged-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 for instance with vm_state deleted and task_state None.
Nov 27 05:06:39 user nova-compute[75260]: DEBUG nova.compute.manager [req-d176861c-911c-498f-b7ca-b6d326b485c7 req-cc360168-04bc-4e02-a3ba-57f0f243e146 service nova] [instance: 1a25081f-79d1-412f-bf99-4235516d40a6] Received event network-vif-deleted-36cb7cdc-1e5a-475f-b055-b06a2c0c7a27 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:06:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-6c279868-aaa3-4f30-8ba9-f3593c58ae10 req-8de057af-91d5-4a03-92cf-0d49845b19e8 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-changed-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:06:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-6c279868-aaa3-4f30-8ba9-f3593c58ae10 req-8de057af-91d5-4a03-92cf-0d49845b19e8 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Refreshing instance network info cache due to event network-changed-caaf84bc-7039-4868-99b4-391387bd4a1e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:06:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6c279868-aaa3-4f30-8ba9-f3593c58ae10 req-8de057af-91d5-4a03-92cf-0d49845b19e8 service nova] Acquiring lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:06:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6c279868-aaa3-4f30-8ba9-f3593c58ae10 req-8de057af-91d5-4a03-92cf-0d49845b19e8 service nova] Acquired lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:06:55 user nova-compute[75260]: DEBUG nova.network.neutron [req-6c279868-aaa3-4f30-8ba9-f3593c58ae10 req-8de057af-91d5-4a03-92cf-0d49845b19e8 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Refreshing network info cache for port caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:06:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-6c279868-aaa3-4f30-8ba9-f3593c58ae10 req-8de057af-91d5-4a03-92cf-0d49845b19e8 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updated VIF entry in instance network info cache for port caaf84bc-7039-4868-99b4-391387bd4a1e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:06:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-6c279868-aaa3-4f30-8ba9-f3593c58ae10 req-8de057af-91d5-4a03-92cf-0d49845b19e8 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updating instance_info_cache with network_info: [{"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:06:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6c279868-aaa3-4f30-8ba9-f3593c58ae10 req-8de057af-91d5-4a03-92cf-0d49845b19e8 service nova] Releasing lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:06:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-8fcd201f-1934-4e83-bfa9-6c5e19f3dbc4 req-369c01b6-e2fc-4b64-ad73-37fa12dc241c service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-changed-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:06:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-8fcd201f-1934-4e83-bfa9-6c5e19f3dbc4 req-369c01b6-e2fc-4b64-ad73-37fa12dc241c service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Refreshing instance network info cache due to event network-changed-caaf84bc-7039-4868-99b4-391387bd4a1e. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:06:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8fcd201f-1934-4e83-bfa9-6c5e19f3dbc4 req-369c01b6-e2fc-4b64-ad73-37fa12dc241c service nova] Acquiring lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:06:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8fcd201f-1934-4e83-bfa9-6c5e19f3dbc4 req-369c01b6-e2fc-4b64-ad73-37fa12dc241c service nova] Acquired lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:06:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-8fcd201f-1934-4e83-bfa9-6c5e19f3dbc4 req-369c01b6-e2fc-4b64-ad73-37fa12dc241c service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Refreshing network info cache for port caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:06:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:06:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:06:57 user nova-compute[75260]: INFO nova.compute.manager [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Detaching volume 4a2f1d7f-0de6-4670-a069-a1dbc7c99a64
Nov 27 05:06:57 user nova-compute[75260]: INFO nova.virt.block_device [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Attempting to driver detach volume 4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 from mountpoint /dev/vdb
Nov 27 05:06:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Attempting to detach device vdb from instance dc56ef1d-a722-4c3d-9d24-b7233d18018c from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 05:06:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:06:57 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:06:57 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 05:06:57 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:06:57 user nova-compute[75260]:   <serial>4a2f1d7f-0de6-4670-a069-a1dbc7c99a64</serial>
Nov 27 05:06:57 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 05:06:57 user nova-compute[75260]: </disk>
Nov 27 05:06:57 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:06:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Successfully detached device vdb from instance dc56ef1d-a722-4c3d-9d24-b7233d18018c from the persistent domain config.
Nov 27 05:06:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dc56ef1d-a722-4c3d-9d24-b7233d18018c from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 05:06:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:06:57 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:06:57 user nova-compute[75260]:   <source dev="/dev/sdc"/>
Nov 27 05:06:57 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:06:57 user nova-compute[75260]:   <serial>4a2f1d7f-0de6-4670-a069-a1dbc7c99a64</serial>
Nov 27 05:06:57 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 05:06:57 user nova-compute[75260]: </disk>
Nov 27 05:06:57 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:06:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-8fcd201f-1934-4e83-bfa9-6c5e19f3dbc4 req-369c01b6-e2fc-4b64-ad73-37fa12dc241c service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updated VIF entry in instance network info cache for port caaf84bc-7039-4868-99b4-391387bd4a1e. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:06:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-8fcd201f-1934-4e83-bfa9-6c5e19f3dbc4 req-369c01b6-e2fc-4b64-ad73-37fa12dc241c service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updating instance_info_cache with network_info: [{"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:06:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-8fcd201f-1934-4e83-bfa9-6c5e19f3dbc4 req-369c01b6-e2fc-4b64-ad73-37fa12dc241c service nova] Releasing lock "refresh_cache-dc56ef1d-a722-4c3d-9d24-b7233d18018c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:06:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:06:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 05:07:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:07:01 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:07:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:07:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:07:01 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updating instance_info_cache with network_info: [{"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-e7c75f6e-668d-49ec-8bc3-b003b839d205" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:02 user nova-compute[75260]: INFO nova.compute.manager [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Terminating instance
Nov 27 05:07:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-bb0baba8-be0c-4e51-825b-2571b3ff2726 req-443f2032-3210-4619-b6b5-530d1ad7296f service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Received event network-vif-unplugged-2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bb0baba8-be0c-4e51-825b-2571b3ff2726 req-443f2032-3210-4619-b6b5-530d1ad7296f service nova] Acquiring lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bb0baba8-be0c-4e51-825b-2571b3ff2726 req-443f2032-3210-4619-b6b5-530d1ad7296f service nova] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bb0baba8-be0c-4e51-825b-2571b3ff2726 req-443f2032-3210-4619-b6b5-530d1ad7296f service nova] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-bb0baba8-be0c-4e51-825b-2571b3ff2726 req-443f2032-3210-4619-b6b5-530d1ad7296f service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] No waiting events found dispatching network-vif-unplugged-2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-bb0baba8-be0c-4e51-825b-2571b3ff2726 req-443f2032-3210-4619-b6b5-530d1ad7296f service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Received event network-vif-unplugged-2e15b159-9ebe-430d-a5b9-0425752221dc for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:07:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:07:03 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Instance destroyed successfully.
Nov 27 05:07:03 user nova-compute[75260]: DEBUG nova.objects.instance [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'resources' on Instance uuid acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1899630999',display_name='tempest-TestVolumeBootPattern-server-1899630999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1899630999',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:05:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-1piut5k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:05:30Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e15b159-9ebe-430d-a5b9-0425752221dc", "address": "fa:16:3e:fe:3a:4b", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e15b159-9e", "ovs_interfaceid": "2e15b159-9ebe-430d-a5b9-0425752221dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "2e15b159-9ebe-430d-a5b9-0425752221dc", "address": "fa:16:3e:fe:3a:4b", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e15b159-9e", "ovs_interfaceid": "2e15b159-9ebe-430d-a5b9-0425752221dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:3a:4b,bridge_name='br-int',has_traffic_filtering=True,id=2e15b159-9ebe-430d-a5b9-0425752221dc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e15b159-9e') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_vif [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:3a:4b,bridge_name='br-int',has_traffic_filtering=True,id=2e15b159-9ebe-430d-a5b9-0425752221dc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e15b159-9e') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e15b159-9e, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5f397a3-b8a3-4582-9bc9-267f38895e64) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:07:03 user nova-compute[75260]: INFO os_vif [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:3a:4b,bridge_name='br-int',has_traffic_filtering=True,id=2e15b159-9ebe-430d-a5b9-0425752221dc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e15b159-9e')
Nov 27 05:07:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKfcbDTx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:07:03 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e83cac-04ec-4437-886f-e7b90438a760]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:07:03 user nova-compute[75260]: No targets found.
Nov 27 05:07:03 user nova-compute[75260]: iSNS:
Nov 27 05:07:03 user nova-compute[75260]: No targets found.
Nov 27 05:07:03 user nova-compute[75260]: STATIC:
Nov 27 05:07:03 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64
Nov 27 05:07:03 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:07:03 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:07:03 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:07:03 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:07:03 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:07:03 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0
Nov 27 05:07:03 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:07:03 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:07:03 user nova-compute[75260]: FIRMWARE:
Nov 27 05:07:03 user nova-compute[75260]: No targets found.
Nov 27 05:07:03 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:07:03 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:07:03 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eec68c-5e7e-4be6-ba72-f705d78de686]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f0b827-fc70-44c3-808c-710463911dc6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:07:03 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:07:03 user nova-compute[75260]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 (non-flash)
Nov 27 05:07:03 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:07:03 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:07:03 user nova-compute[75260]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 (non-flash)
Nov 27 05:07:03 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c2b71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d2c506-aa91-4118-b7cf-2b9e16ea701a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[944c91ff-3cbd-4e0f-9854-52b1e511536a]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c71555-a97c-494a-aa7e-d333f736203d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac02afb4-cad9-4e0a-aa6b-a40c5d521b60]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cd9bf1-9565-41ab-a9c4-7910ff19897e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8b5a32-3341-44c5-8374-cb80c1f1e53b]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0, portal: 172.16.0.220,3260]
Nov 27 05:07:03 user nova-compute[75260]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0, portal: 172.16.0.220,3260] successful.
Nov 27 05:07:03 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a066b398-7e1e-4a7f-9646-902187a8661b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== disconnect_volume: return (330ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:07:03 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Deleting instance files /opt/stack/data/nova/instances/acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484_del
Nov 27 05:07:03 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Deletion of /opt/stack/data/nova/instances/acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484_del complete
Nov 27 05:07:03 user nova-compute[75260]: INFO nova.compute.manager [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 27 05:07:03 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:07:03 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:07:04 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:07:04 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Took 0.53 seconds to deallocate network for instance.
Nov 27 05:07:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6b0fb26-3d0e-4e0c-a987-59f67bbd4da8 req-13907d99-3518-4a17-af33-a7163e8b9a20 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Received event network-vif-plugged-2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6b0fb26-3d0e-4e0c-a987-59f67bbd4da8 req-13907d99-3518-4a17-af33-a7163e8b9a20 service nova] Acquiring lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6b0fb26-3d0e-4e0c-a987-59f67bbd4da8 req-13907d99-3518-4a17-af33-a7163e8b9a20 service nova] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:04 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d6b0fb26-3d0e-4e0c-a987-59f67bbd4da8 req-13907d99-3518-4a17-af33-a7163e8b9a20 service nova] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6b0fb26-3d0e-4e0c-a987-59f67bbd4da8 req-13907d99-3518-4a17-af33-a7163e8b9a20 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] No waiting events found dispatching network-vif-plugged-2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:07:04 user nova-compute[75260]: WARNING nova.compute.manager [req-d6b0fb26-3d0e-4e0c-a987-59f67bbd4da8 req-13907d99-3518-4a17-af33-a7163e8b9a20 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Received unexpected event network-vif-plugged-2e15b159-9ebe-430d-a5b9-0425752221dc for instance with vm_state active and task_state deleting.
Nov 27 05:07:04 user nova-compute[75260]: DEBUG nova.compute.manager [req-d6b0fb26-3d0e-4e0c-a987-59f67bbd4da8 req-13907d99-3518-4a17-af33-a7163e8b9a20 service nova] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Received event network-vif-deleted-2e15b159-9ebe-430d-a5b9-0425752221dc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:07:05 user nova-compute[75260]: INFO nova.compute.manager [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Took 0.75 seconds to detach 1 volumes for instance.
Nov 27 05:07:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484] Deleting volume: 6d82be5e-611b-42b7-b8f7-9fe15d61c7d0 {{(pid=75260) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 05:07:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:05 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:07:05 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:07:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:05 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Deleted allocations for instance acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484
Nov 27 05:07:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d72b07f8-0e01-43e8-80af-81b5c2e1908a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "acf1c7b8-a8ed-4ce1-a270-c2b4fdcef484" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.943s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:06 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:07:06 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:07:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:06 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:08 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:07:08 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:07:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=25.114700317382812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance dc56ef1d-a722-4c3d-9d24-b7233d18018c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d7e4e399-4234-498c-b87a-9ed75477e2b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:07:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:17 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dc56ef1d-a722-4c3d-9d24-b7233d18018c is timed out.
Nov 27 05:07:17 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Successfully detached device vdb from instance dc56ef1d-a722-4c3d-9d24-b7233d18018c from the live domain config.
Nov 27 05:07:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLVDsNTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:07:17 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a0d67e-7ab2-4d34-a797-d157a8620f7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:07:17 user nova-compute[75260]: No targets found.
Nov 27 05:07:17 user nova-compute[75260]: iSNS:
Nov 27 05:07:17 user nova-compute[75260]: No targets found.
Nov 27 05:07:17 user nova-compute[75260]: STATIC:
Nov 27 05:07:17 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64
Nov 27 05:07:17 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:07:17 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:07:17 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:07:17 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:07:17 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:07:17 user nova-compute[75260]: FIRMWARE:
Nov 27 05:07:17 user nova-compute[75260]: No targets found.
Nov 27 05:07:17 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:07:17 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:07:17 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06a96ca-643e-4548-aeb7-825c8aebc32a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80009c8-0ba4-447e-bfad-0d1b5d6a3b18]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:07:17 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:07:17 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:07:17 user nova-compute[75260]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 (non-flash)
Nov 27 05:07:17 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54242cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c1e466-69bb-44a4-b1fc-2dbfa5b58600]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[606fcec1-629a-483f-855d-5873df5cc1ad]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebc2e24-85eb-4736-ba7d-50901036d51c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[54579258-2d6c-4e82-8b62-739d5b676ef8]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[252fe2c7-eb2a-4da6-aaef-115e2799cbc1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:07:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81df7e3-5ecd-410f-83a5-34fc39c2b21a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260]
Nov 27 05:07:18 user nova-compute[75260]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64, portal: 172.16.0.220,3260] successful.
Nov 27 05:07:18 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a2f1d7f-0de6-4670-a069-a1dbc7c99a64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea35170b-f503-48b0-b0e8-695ada04f0e6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] <== disconnect_volume: return (305ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG nova.objects.instance [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'flavor' on Instance uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:07:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-d7d15e0c-a478-4163-a763-97d623117564 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.629s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:27 user nova-compute[75260]: INFO nova.compute.manager [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Terminating instance
Nov 27 05:07:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-d1da2859-73ff-45ab-a084-be61eeff9f5f req-31fc0155-3766-4a6e-a8c2-7c753037ea90 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-unplugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d1da2859-73ff-45ab-a084-be61eeff9f5f req-31fc0155-3766-4a6e-a8c2-7c753037ea90 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d1da2859-73ff-45ab-a084-be61eeff9f5f req-31fc0155-3766-4a6e-a8c2-7c753037ea90 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d1da2859-73ff-45ab-a084-be61eeff9f5f req-31fc0155-3766-4a6e-a8c2-7c753037ea90 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-d1da2859-73ff-45ab-a084-be61eeff9f5f req-31fc0155-3766-4a6e-a8c2-7c753037ea90 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-unplugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-d1da2859-73ff-45ab-a084-be61eeff9f5f req-31fc0155-3766-4a6e-a8c2-7c753037ea90 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-unplugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Instance destroyed successfully.
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.objects.instance [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'resources' on Instance uuid e7c75f6e-668d-49ec-8bc3-b003b839d205 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-665818185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-665818185',id=31,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:53:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-50cm5jfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:55:28Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=e7c75f6e-668d-49ec-8bc3-b003b839d205,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "de4a339f-5096-4327-8a9f-16433c75a112", "address": "fa:16:3e:54:34:6c", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a339f-50", "ovs_interfaceid": "de4a339f-5096-4327-8a9f-16433c75a112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:34:6c,bridge_name='br-int',has_traffic_filtering=True,id=de4a339f-5096-4327-8a9f-16433c75a112,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a339f-50') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_vif [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:34:6c,bridge_name='br-int',has_traffic_filtering=True,id=de4a339f-5096-4327-8a9f-16433c75a112,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a339f-50') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde4a339f-50, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f91b827-e8ca-4456-86d8-528466344cb8) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:07:28 user nova-compute[75260]: INFO os_vif [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:34:6c,bridge_name='br-int',has_traffic_filtering=True,id=de4a339f-5096-4327-8a9f-16433c75a112,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a339f-50')
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqgnjUwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:07:28 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a52bd8-d7f7-42b2-ba65-2728de6c887c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:07:28 user nova-compute[75260]: No targets found.
Nov 27 05:07:28 user nova-compute[75260]: iSNS:
Nov 27 05:07:28 user nova-compute[75260]: No targets found.
Nov 27 05:07:28 user nova-compute[75260]: STATIC:
Nov 27 05:07:28 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad
Nov 27 05:07:28 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:07:28 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:07:28 user nova-compute[75260]: FIRMWARE:
Nov 27 05:07:28 user nova-compute[75260]: No targets found.
Nov 27 05:07:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:07:28 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:07:28 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[51803a54-75a4-423b-b99c-beb2cd8537ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2a895d-e519-41d3-97cb-6a5855915dd5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:07:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad (non-flash)
Nov 27 05:07:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb544637f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad'): ({'sdf'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Removing single pathed devices sdf {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a65551-db01-41ee-b61b-abfd2122e690]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faed1c0-2fba-4052-b4ec-650252b9fe11]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Flushing IO for device /dev/sdf {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f003d2-9d0e-49d8-bf5a-344f52f3377d]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c365ed-428c-436f-8ab7-5518b9c76725]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] SCSI volumes sdf have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45059e1-3285-487b-a264-00589acbe3e6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e950f26-f7ef-46f1-9faf-bcdfe9fb72e4]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad, portal: 172.16.0.220,3260]
Nov 27 05:07:28 user nova-compute[75260]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad, portal: 172.16.0.220,3260] successful.
Nov 27 05:07:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01add167-eeb1-4fe2-81c7-32f3d08563ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0091bb-658d-4899-af4d-74db9c86e7bd]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] <== disconnect_volume: return (284ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:07:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Deleting instance files /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205_del
Nov 27 05:07:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Deletion of /opt/stack/data/nova/instances/e7c75f6e-668d-49ec-8bc3-b003b839d205_del complete
Nov 27 05:07:28 user nova-compute[75260]: INFO nova.compute.manager [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 27 05:07:28 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:07:28 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Took 0.40 seconds to deallocate network for instance.
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-ee1127f2-4daa-4be5-9a3b-d66305207f88 req-05d897f8-5120-4eef-8b92-c03090800f2f service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-deleted-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:28 user nova-compute[75260]: INFO nova.compute.manager [req-ee1127f2-4daa-4be5-9a3b-d66305207f88 req-05d897f8-5120-4eef-8b92-c03090800f2f service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Neutron deleted interface de4a339f-5096-4327-8a9f-16433c75a112; detaching it from the instance and deleting it from the info cache
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.network.neutron [req-ee1127f2-4daa-4be5-9a3b-d66305207f88 req-05d897f8-5120-4eef-8b92-c03090800f2f service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:07:28 user nova-compute[75260]: DEBUG nova.compute.manager [req-ee1127f2-4daa-4be5-9a3b-d66305207f88 req-05d897f8-5120-4eef-8b92-c03090800f2f service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Detach interface failed, port_id=de4a339f-5096-4327-8a9f-16433c75a112, reason: Instance e7c75f6e-668d-49ec-8bc3-b003b839d205 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 05:07:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-a26943c8-6dd0-4c90-87ae-df79380d84ba req-67333466-9aac-4ed0-941e-d25b7a299371 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a26943c8-6dd0-4c90-87ae-df79380d84ba req-67333466-9aac-4ed0-941e-d25b7a299371 service nova] Acquiring lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a26943c8-6dd0-4c90-87ae-df79380d84ba req-67333466-9aac-4ed0-941e-d25b7a299371 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a26943c8-6dd0-4c90-87ae-df79380d84ba req-67333466-9aac-4ed0-941e-d25b7a299371 service nova] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-a26943c8-6dd0-4c90-87ae-df79380d84ba req-67333466-9aac-4ed0-941e-d25b7a299371 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] No waiting events found dispatching network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:07:29 user nova-compute[75260]: WARNING nova.compute.manager [req-a26943c8-6dd0-4c90-87ae-df79380d84ba req-67333466-9aac-4ed0-941e-d25b7a299371 service nova] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Received unexpected event network-vif-plugged-de4a339f-5096-4327-8a9f-16433c75a112 for instance with vm_state active and task_state deleting.
Nov 27 05:07:29 user nova-compute[75260]: INFO nova.compute.manager [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: e7c75f6e-668d-49ec-8bc3-b003b839d205] Took 0.76 seconds to detach 1 volumes for instance.
Nov 27 05:07:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:29 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:07:29 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:07:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:29 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Deleted allocations for instance e7c75f6e-668d-49ec-8bc3-b003b839d205
Nov 27 05:07:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-720f3c5c-d44f-4267-8ac0-ae08ff7ea21f tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "e7c75f6e-668d-49ec-8bc3-b003b839d205" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.679s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:07:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:07:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:07:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:07:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:07:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:50 user nova-compute[75260]: INFO nova.compute.manager [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Terminating instance
Nov 27 05:07:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:07:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-179f21ff-ba6f-4c25-b95f-785a44a9e338 req-79173da9-0e2d-4e33-b08f-e7c4f72e0493 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-unplugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-179f21ff-ba6f-4c25-b95f-785a44a9e338 req-79173da9-0e2d-4e33-b08f-e7c4f72e0493 service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-179f21ff-ba6f-4c25-b95f-785a44a9e338 req-79173da9-0e2d-4e33-b08f-e7c4f72e0493 service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-179f21ff-ba6f-4c25-b95f-785a44a9e338 req-79173da9-0e2d-4e33-b08f-e7c4f72e0493 service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-179f21ff-ba6f-4c25-b95f-785a44a9e338 req-79173da9-0e2d-4e33-b08f-e7c4f72e0493 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-unplugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-179f21ff-ba6f-4c25-b95f-785a44a9e338 req-79173da9-0e2d-4e33-b08f-e7c4f72e0493 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-unplugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Instance destroyed successfully.
Nov 27 05:07:51 user nova-compute[75260]: DEBUG nova.objects.instance [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'resources' on Instance uuid dc56ef1d-a722-4c3d-9d24-b7233d18018c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-693034548',display_name='tempest-TestMinimumBasicScenario-server-693034548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-693034548',id=43,image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU2zN3v9oVCiggBA5zHD8JmoZleg+rDjqNxhjG4l1CzZldqjmA/+FDQYVcFjRfjYVF7IVddPZ6X7/dbN3Vp3r6Rl3gM0ey358L9QSrG80I2HFLoYJV6FdEaOHxVFljKXg==',key_name='tempest-TestMinimumBasicScenario-494858082',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fc3728cb2564827a26f40cbc0ec6b5f',ramdisk_id='',reservation_id='r-1pgqw0l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='13f29525-2b44-4a8a-be17-73a7879c0207',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-372834875',owner_user_name='tempest-TestMinimumBasicScenario-372834875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:05:12Z,user_data=None,user_id='e509f168517f4fef82ce3d34122fd59d',uuid=dc56ef1d-a722-4c3d-9d24-b7233d18018c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converting VIF {"id": "caaf84bc-7039-4868-99b4-391387bd4a1e", "address": "fa:16:3e:44:e4:f8", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaf84bc-70", "ovs_interfaceid": "caaf84bc-7039-4868-99b4-391387bd4a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG os_vif [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcaaf84bc-70, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67ee1b2d-94f3-41f6-90bf-83d395945f41) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:07:51 user nova-compute[75260]: INFO os_vif [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:e4:f8,bridge_name='br-int',has_traffic_filtering=True,id=caaf84bc-7039-4868-99b4-391387bd4a1e,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaf84bc-70')
Nov 27 05:07:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Deleting instance files /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c_del
Nov 27 05:07:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Deletion of /opt/stack/data/nova/instances/dc56ef1d-a722-4c3d-9d24-b7233d18018c_del complete
Nov 27 05:07:51 user nova-compute[75260]: INFO nova.compute.manager [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 27 05:07:51 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:07:51 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:07:52 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Took 0.89 seconds to deallocate network for instance.
Nov 27 05:07:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-ddc05bef-16d9-4ffa-b7e7-dd6bfeb92a1a req-493e8a81-1bc9-4a77-bd8d-e4259f1dbb99 service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-deleted-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:07:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:52 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Deleted allocations for instance dc56ef1d-a722-4c3d-9d24-b7233d18018c
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-776c8882-8d27-424c-a5c4-9712415fa64b tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.142s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:07:53 user nova-compute[75260]: WARNING nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state deleted and task_state None.
Nov 27 05:07:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:07:53 user nova-compute[75260]: WARNING nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state deleted and task_state None.
Nov 27 05:07:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:07:53 user nova-compute[75260]: WARNING nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state deleted and task_state None.
Nov 27 05:07:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-unplugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-unplugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:07:53 user nova-compute[75260]: WARNING nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-unplugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state deleted and task_state None.
Nov 27 05:07:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Acquiring lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] Lock "dc56ef1d-a722-4c3d-9d24-b7233d18018c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:07:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] No waiting events found dispatching network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:07:53 user nova-compute[75260]: WARNING nova.compute.manager [req-88080390-8518-488e-a0d1-fe37da60e003 req-93364c43-08df-4726-8e35-7fcda35ae70b service nova] [instance: dc56ef1d-a722-4c3d-9d24-b7233d18018c] Received unexpected event network-vif-plugged-caaf84bc-7039-4868-99b4-391387bd4a1e for instance with vm_state deleted and task_state None.
Nov 27 05:07:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:08:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:08:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:08:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:08:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:08:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 05:08:03 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:08:03 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:08:03 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:08:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:08:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:08:07 user nova-compute[75260]: INFO nova.compute.claims [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Claim successful on node user
Nov 27 05:08:07 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:08:07 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:08:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG nova.policy [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bbd9c9317ac4d34ad23932bb35bcc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b302e83cda4b6bacc8e613016c8189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:08:07 user nova-compute[75260]: INFO nova.virt.block_device [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Booting with volume 976ffee5-7156-429d-bd5d-1b19d6eb94c3 at /dev/vda
Nov 27 05:08:07 user nova-compute[75260]: DEBUG os_brick.utils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1151fa09-e10f-4a3a-8b91-40da0ac72b15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[04caf407-f794-448f-8c6b-6b65751e5b7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f08832a-7c64-4480-af8f-1f1c798ab5f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cee289e-4e61-44f6-995e-14dfdf5c7b69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:08:07 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:08:07 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6bca3b-aaac-4ee1-b91a-028649546b19]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG os_brick.utils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:08:07 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updating existing volume attachment record: 9f372c99-36fc-4a86-9e04-da17ed9a1b12 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Successfully created port: 65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Successfully updated port: 65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquired lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:08:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-fdc46f2c-a5ed-44aa-aac0-5ce86de7ad81 req-2adb6419-132a-4d66-a734-9d7f6d2301c4 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received event network-changed-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG nova.compute.manager [req-fdc46f2c-a5ed-44aa-aac0-5ce86de7ad81 req-2adb6419-132a-4d66-a734-9d7f6d2301c4 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Refreshing instance network info cache due to event network-changed-65596b71-101a-4ee5-82e8-45ea7fd38708. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fdc46f2c-a5ed-44aa-aac0-5ce86de7ad81 req-2adb6419-132a-4d66-a734-9d7f6d2301c4 service nova] Acquiring lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updating instance_info_cache with network_info: [{"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Releasing lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Instance network_info: |[{"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fdc46f2c-a5ed-44aa-aac0-5ce86de7ad81 req-2adb6419-132a-4d66-a734-9d7f6d2301c4 service nova] Acquired lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG nova.network.neutron [req-fdc46f2c-a5ed-44aa-aac0-5ce86de7ad81 req-2adb6419-132a-4d66-a734-9d7f6d2301c4 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Refreshing network info cache for port 65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:09 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:10 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:08:10 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=25.133148193359375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.network.neutron [req-fdc46f2c-a5ed-44aa-aac0-5ce86de7ad81 req-2adb6419-132a-4d66-a734-9d7f6d2301c4 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updated VIF entry in instance network info cache for port 65596b71-101a-4ee5-82e8-45ea7fd38708. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.network.neutron [req-fdc46f2c-a5ed-44aa-aac0-5ce86de7ad81 req-2adb6419-132a-4d66-a734-9d7f6d2301c4 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updating instance_info_cache with network_info: [{"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-fdc46f2c-a5ed-44aa-aac0-5ce86de7ad81 req-2adb6419-132a-4d66-a734-9d7f6d2301c4 service nova] Releasing lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d7e4e399-4234-498c-b87a-9ed75477e2b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance c0f2d0d5-6181-4702-b582-0ab94adc8fc3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:08:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:08:14 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Creating image(s)
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Ensure instance console log exists: /opt/stack/data/nova/instances/c0f2d0d5-6181-4702-b582-0ab94adc8fc3/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Start _get_guest_xml network_info=[{"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '9f372c99-36fc-4a86-9e04-da17ed9a1b12', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjqPyAZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0f2d0d5-6181-4702-b582-0ab94adc8fc3', 'attached_at': '', 'detached_at': '', 'volume_id': '976ffee5-7156-429d-bd5d-1b19d6eb94c3', 'serial': '976ffee5-7156-429d-bd5d-1b19d6eb94c3'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:08:14 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:08:14 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjqPyAZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:08:14 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:08:14 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:08:14 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0858aa-2997-431c-8ee9-15ee03a2d647]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:08:14 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd6580a-fabb-4d6d-9050-0d887c2d3ddc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3] added
Nov 27 05:08:14 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9906827-cc57-4d8d-9794-e72c61764850]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c059e9-c42d-4df8-be48-55b5bdec9aac]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjqPyAZf {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjqPyAZf" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6021b01c-eaa4-4453-9f16-a290d0708129]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjqPyAZf'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82aee0d-f509-48ef-9469-d28d4e3a9b2c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a445311-750a-42fd-bcce-6d1846077f07]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 05:08:14 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 05:08:14 user nova-compute[75260]:  {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:08:14 user nova-compute[75260]: WARNING os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 05:08:14 user nova-compute[75260]: 
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25d69ce-8fd2-4bb7-b2d8-09a5bb32db15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3, portal: 172.16.0.220,3260]
Nov 27 05:08:14 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3, portal: 172.16.0.220,3260] successful.
Nov 27 05:08:14 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fc5bd2-bf28-4f39-b5b4-96a9b8d2535c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6ef4c4-1b65-4d47-9229-2c48846589c8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:08:14 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:08:14 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e699e84-5bb9-4869-96c3-ea08a09ffa43]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:08:14 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjqPyAZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23132363963393931', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132363963393931', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1265124460',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1265124460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1265124460',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3Kml+UxtFy/tZij1yctuEcq5/61b7J29BVUMb+9A/hOEWyk+Et6KbP0Pjhojv30ttuURNSg/90d95QOKlkSGeG2SZQ/XJ5iIIgxDZXdecmeS7SiebC05D2dEDH5rN/vA==',key_name='tempest-keypair-456010302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-v96r06cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=c0f2d0d5-6181-4702-b582-0ab94adc8fc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:2e:c2,bridge_name='br-int',has_traffic_filtering=True,id=65596b71-101a-4ee5-82e8-45ea7fd38708,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65596b71-10') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'pci_devices' on Instance uuid c0f2d0d5-6181-4702-b582-0ab94adc8fc3 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:08:15 user nova-compute[75260]:   <uuid>c0f2d0d5-6181-4702-b582-0ab94adc8fc3</uuid>
Nov 27 05:08:15 user nova-compute[75260]:   <name>instance-0000002e</name>
Nov 27 05:08:15 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:08:15 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:08:15 user nova-compute[75260]:   <metadata>
Nov 27 05:08:15 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:08:15 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:08:15 user nova-compute[75260]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1265124460</nova:name>
Nov 27 05:08:15 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:08:14</nova:creationTime>
Nov 27 05:08:15 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:08:15 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:08:15 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:08:15 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:08:15 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:08:15 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:08:15 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:08:15 user nova-compute[75260]:       <nova:owner>
Nov 27 05:08:15 user nova-compute[75260]:         <nova:user uuid="5bbd9c9317ac4d34ad23932bb35bcc87">tempest-TestVolumeBootPattern-1806325901-project-member</nova:user>
Nov 27 05:08:15 user nova-compute[75260]:         <nova:project uuid="c4b302e83cda4b6bacc8e613016c8189">tempest-TestVolumeBootPattern-1806325901</nova:project>
Nov 27 05:08:15 user nova-compute[75260]:       </nova:owner>
Nov 27 05:08:15 user nova-compute[75260]:       <nova:ports>
Nov 27 05:08:15 user nova-compute[75260]:         <nova:port uuid="65596b71-101a-4ee5-82e8-45ea7fd38708">
Nov 27 05:08:15 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 05:08:15 user nova-compute[75260]:         </nova:port>
Nov 27 05:08:15 user nova-compute[75260]:       </nova:ports>
Nov 27 05:08:15 user nova-compute[75260]:     </nova:instance>
Nov 27 05:08:15 user nova-compute[75260]:   </metadata>
Nov 27 05:08:15 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:08:15 user nova-compute[75260]:     <system>
Nov 27 05:08:15 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:08:15 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:08:15 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:08:15 user nova-compute[75260]:       <entry name="serial">c0f2d0d5-6181-4702-b582-0ab94adc8fc3</entry>
Nov 27 05:08:15 user nova-compute[75260]:       <entry name="uuid">c0f2d0d5-6181-4702-b582-0ab94adc8fc3</entry>
Nov 27 05:08:15 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:08:15 user nova-compute[75260]:     </system>
Nov 27 05:08:15 user nova-compute[75260]:   </sysinfo>
Nov 27 05:08:15 user nova-compute[75260]:   <os>
Nov 27 05:08:15 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:08:15 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:08:15 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:08:15 user nova-compute[75260]:   </os>
Nov 27 05:08:15 user nova-compute[75260]:   <features>
Nov 27 05:08:15 user nova-compute[75260]:     <acpi/>
Nov 27 05:08:15 user nova-compute[75260]:     <apic/>
Nov 27 05:08:15 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:08:15 user nova-compute[75260]:   </features>
Nov 27 05:08:15 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:08:15 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:08:15 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:08:15 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:08:15 user nova-compute[75260]:   </clock>
Nov 27 05:08:15 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:08:15 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:08:15 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:08:15 user nova-compute[75260]:   </cpu>
Nov 27 05:08:15 user nova-compute[75260]:   <devices>
Nov 27 05:08:15 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:08:15 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:08:15 user nova-compute[75260]:       <source dev="/dev/sdb"/>
Nov 27 05:08:15 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:08:15 user nova-compute[75260]:       <serial>976ffee5-7156-429d-bd5d-1b19d6eb94c3</serial>
Nov 27 05:08:15 user nova-compute[75260]:     </disk>
Nov 27 05:08:15 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:08:15 user nova-compute[75260]:       <mac address="fa:16:3e:30:2e:c2"/>
Nov 27 05:08:15 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:08:15 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:08:15 user nova-compute[75260]:       <target dev="tap65596b71-10"/>
Nov 27 05:08:15 user nova-compute[75260]:     </interface>
Nov 27 05:08:15 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:08:15 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/c0f2d0d5-6181-4702-b582-0ab94adc8fc3/console.log" append="off"/>
Nov 27 05:08:15 user nova-compute[75260]:     </serial>
Nov 27 05:08:15 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:08:15 user nova-compute[75260]:     <video>
Nov 27 05:08:15 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:08:15 user nova-compute[75260]:     </video>
Nov 27 05:08:15 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:08:15 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:08:15 user nova-compute[75260]:     </rng>
Nov 27 05:08:15 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:08:15 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:08:15 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:08:15 user nova-compute[75260]:     </memballoon>
Nov 27 05:08:15 user nova-compute[75260]:   </devices>
Nov 27 05:08:15 user nova-compute[75260]: </domain>
Nov 27 05:08:15 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1265124460',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1265124460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1265124460',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3Kml+UxtFy/tZij1yctuEcq5/61b7J29BVUMb+9A/hOEWyk+Et6KbP0Pjhojv30ttuURNSg/90d95QOKlkSGeG2SZQ/XJ5iIIgxDZXdecmeS7SiebC05D2dEDH5rN/vA==',key_name='tempest-keypair-456010302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-v96r06cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=c0f2d0d5-6181-4702-b582-0ab94adc8fc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:2e:c2,bridge_name='br-int',has_traffic_filtering=True,id=65596b71-101a-4ee5-82e8-45ea7fd38708,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65596b71-10') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG os_vif [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:2e:c2,bridge_name='br-int',has_traffic_filtering=True,id=65596b71-101a-4ee5-82e8-45ea7fd38708,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65596b71-10') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9c0f4c8-7654-5400-aad5-4b6caf257f1f', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65596b71-10, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65596b71-10, col_values=(('qos', UUID('a3cd248f-8758-48e8-bdf6-cece0d2e55c0')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65596b71-10, col_values=(('external_ids', {'iface-id': '65596b71-101a-4ee5-82e8-45ea7fd38708', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:2e:c2', 'vm-uuid': 'c0f2d0d5-6181-4702-b582-0ab94adc8fc3'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:15 user nova-compute[75260]: INFO os_vif [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:2e:c2,bridge_name='br-int',has_traffic_filtering=True,id=65596b71-101a-4ee5-82e8-45ea7fd38708,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65596b71-10')
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No VIF found with MAC fa:16:3e:30:2e:c2, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-763407a9-efee-4cf2-bc36-985cdfc37be8 req-3fc4d3a7-766d-4d00-b436-b05d5ad2514c service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-changed-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.compute.manager [req-763407a9-efee-4cf2-bc36-985cdfc37be8 req-3fc4d3a7-766d-4d00-b436-b05d5ad2514c service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Refreshing instance network info cache due to event network-changed-3a757f70-bf6a-4b7b-b62c-adc9c158836f. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-763407a9-efee-4cf2-bc36-985cdfc37be8 req-3fc4d3a7-766d-4d00-b436-b05d5ad2514c service nova] Acquiring lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-763407a9-efee-4cf2-bc36-985cdfc37be8 req-3fc4d3a7-766d-4d00-b436-b05d5ad2514c service nova] Acquired lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:08:15 user nova-compute[75260]: DEBUG nova.network.neutron [req-763407a9-efee-4cf2-bc36-985cdfc37be8 req-3fc4d3a7-766d-4d00-b436-b05d5ad2514c service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Refreshing network info cache for port 3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:08:16 user nova-compute[75260]: DEBUG nova.network.neutron [req-763407a9-efee-4cf2-bc36-985cdfc37be8 req-3fc4d3a7-766d-4d00-b436-b05d5ad2514c service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updated VIF entry in instance network info cache for port 3a757f70-bf6a-4b7b-b62c-adc9c158836f. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:08:16 user nova-compute[75260]: DEBUG nova.network.neutron [req-763407a9-efee-4cf2-bc36-985cdfc37be8 req-3fc4d3a7-766d-4d00-b436-b05d5ad2514c service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updating instance_info_cache with network_info: [{"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:08:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-763407a9-efee-4cf2-bc36-985cdfc37be8 req-3fc4d3a7-766d-4d00-b436-b05d5ad2514c service nova] Releasing lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:08:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received event network-vif-plugged-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] Acquiring lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] No waiting events found dispatching network-vif-plugged-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:08:17 user nova-compute[75260]: WARNING nova.compute.manager [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received unexpected event network-vif-plugged-65596b71-101a-4ee5-82e8-45ea7fd38708 for instance with vm_state building and task_state spawning.
Nov 27 05:08:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received event network-vif-plugged-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] Acquiring lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:17 user nova-compute[75260]: DEBUG nova.compute.manager [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] No waiting events found dispatching network-vif-plugged-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:08:17 user nova-compute[75260]: WARNING nova.compute.manager [req-d2cfef29-222a-43ea-aafa-c812e4dc2762 req-0ed9ee1d-ed5f-4315-93e6-f4855c228ba0 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received unexpected event network-vif-plugged-65596b71-101a-4ee5-82e8-45ea7fd38708 for instance with vm_state building and task_state spawning.
Nov 27 05:08:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:18 user nova-compute[75260]: INFO nova.compute.manager [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Terminating instance
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.compute.manager [req-c6c417d0-e068-4619-bdfe-3318377cbd6c req-78ef9b64-19c1-4531-95b6-e54fcf416146 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Received event network-vif-unplugged-9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c6c417d0-e068-4619-bdfe-3318377cbd6c req-78ef9b64-19c1-4531-95b6-e54fcf416146 service nova] Acquiring lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c6c417d0-e068-4619-bdfe-3318377cbd6c req-78ef9b64-19c1-4531-95b6-e54fcf416146 service nova] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c6c417d0-e068-4619-bdfe-3318377cbd6c req-78ef9b64-19c1-4531-95b6-e54fcf416146 service nova] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.compute.manager [req-c6c417d0-e068-4619-bdfe-3318377cbd6c req-78ef9b64-19c1-4531-95b6-e54fcf416146 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] No waiting events found dispatching network-vif-unplugged-9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.compute.manager [req-c6c417d0-e068-4619-bdfe-3318377cbd6c req-78ef9b64-19c1-4531-95b6-e54fcf416146 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Received event network-vif-unplugged-9298a7c3-676a-4c42-806f-f47c18e8097b for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:08:18 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Instance destroyed successfully.
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.objects.instance [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lazy-loading 'resources' on Instance uuid 1b25e35f-08c6-46e6-8dd4-4a50a2028c33 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:08:18 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Instance spawned successfully.
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T04:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1048749684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1048749684',id=26,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T04:48:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eada319615449deb2152f59ba3d3e6d',ramdisk_id='',reservation_id='r-0q2dmi1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293744143',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T04:50:39Z,user_data=None,user_id='05cdf3b00bfe4f728e7fa4e17eba3c4e',uuid=1b25e35f-08c6-46e6-8dd4-4a50a2028c33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converting VIF {"id": "9298a7c3-676a-4c42-806f-f47c18e8097b", "address": "fa:16:3e:c2:1f:1a", "network": {"id": "531a5eb5-ee20-4731-932e-499e088363cf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1957629124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eada319615449deb2152f59ba3d3e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9298a7c3-67", "ovs_interfaceid": "9298a7c3-676a-4c42-806f-f47c18e8097b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:1f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9298a7c3-676a-4c42-806f-f47c18e8097b,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9298a7c3-67') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG os_vif [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:1f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9298a7c3-676a-4c42-806f-f47c18e8097b,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9298a7c3-67') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9298a7c3-67, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58c0a7cb-f12f-4c07-b53d-f851c1d75d30) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:08:18 user nova-compute[75260]: INFO os_vif [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:1f:1a,bridge_name='br-int',has_traffic_filtering=True,id=9298a7c3-676a-4c42-806f-f47c18e8097b,network=Network(531a5eb5-ee20-4731-932e-499e088363cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9298a7c3-67')
Nov 27 05:08:18 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Deleting instance files /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33_del
Nov 27 05:08:18 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Deletion of /opt/stack/data/nova/instances/1b25e35f-08c6-46e6-8dd4-4a50a2028c33_del complete
Nov 27 05:08:19 user nova-compute[75260]: INFO nova.compute.manager [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 27 05:08:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:08:19 user nova-compute[75260]: INFO nova.compute.manager [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 27 05:08:19 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:08:19 user nova-compute[75260]: INFO nova.compute.manager [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Took 11.95 seconds to build instance.
Nov 27 05:08:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f5f573d8-1a68-42d8-bc6b-32d10885dbb3 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.069s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:19 user nova-compute[75260]: INFO nova.compute.manager [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Shelving
Nov 27 05:08:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-e48552ac-8d49-4f7f-935a-1115e42be5ee req-87790109-3435-4e9c-a426-36a07e7c46b7 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-vif-unplugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e48552ac-8d49-4f7f-935a-1115e42be5ee req-87790109-3435-4e9c-a426-36a07e7c46b7 service nova] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e48552ac-8d49-4f7f-935a-1115e42be5ee req-87790109-3435-4e9c-a426-36a07e7c46b7 service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e48552ac-8d49-4f7f-935a-1115e42be5ee req-87790109-3435-4e9c-a426-36a07e7c46b7 service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-e48552ac-8d49-4f7f-935a-1115e42be5ee req-87790109-3435-4e9c-a426-36a07e7c46b7 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] No waiting events found dispatching network-vif-unplugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:08:19 user nova-compute[75260]: WARNING nova.compute.manager [req-e48552ac-8d49-4f7f-935a-1115e42be5ee req-87790109-3435-4e9c-a426-36a07e7c46b7 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received unexpected event network-vif-unplugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f for instance with vm_state active and task_state shelving.
Nov 27 05:08:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:19 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:08:19 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Instance destroyed successfully.
Nov 27 05:08:19 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Took 0.90 seconds to deallocate network for instance.
Nov 27 05:08:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:20 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Beginning cold snapshot process
Nov 27 05:08:20 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:08:20 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:08:20 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 05:08:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk /opt/stack/data/nova/instances/snapshots/tmpbje3xorl/86fa664247954bd299a495c13d8c0aa1 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:20 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Deleted allocations for instance 1b25e35f-08c6-46e6-8dd4-4a50a2028c33
Nov 27 05:08:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f9b5c9d-0e72-4a3e-9cfb-9e337f4e802b tempest-ServerBootFromVolumeStableRescueTest-293744143 tempest-ServerBootFromVolumeStableRescueTest-293744143-project-member] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.380s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-51475de9-5f78-4445-a1e2-ec3dddf5f3b0 req-269081e4-9266-458d-b22f-e8a3a4fa0215 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Received event network-vif-plugged-9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-51475de9-5f78-4445-a1e2-ec3dddf5f3b0 req-269081e4-9266-458d-b22f-e8a3a4fa0215 service nova] Acquiring lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-51475de9-5f78-4445-a1e2-ec3dddf5f3b0 req-269081e4-9266-458d-b22f-e8a3a4fa0215 service nova] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-51475de9-5f78-4445-a1e2-ec3dddf5f3b0 req-269081e4-9266-458d-b22f-e8a3a4fa0215 service nova] Lock "1b25e35f-08c6-46e6-8dd4-4a50a2028c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:20 user nova-compute[75260]: DEBUG nova.compute.manager [req-51475de9-5f78-4445-a1e2-ec3dddf5f3b0 req-269081e4-9266-458d-b22f-e8a3a4fa0215 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] No waiting events found dispatching network-vif-plugged-9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:08:20 user nova-compute[75260]: WARNING nova.compute.manager [req-51475de9-5f78-4445-a1e2-ec3dddf5f3b0 req-269081e4-9266-458d-b22f-e8a3a4fa0215 service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Received unexpected event network-vif-plugged-9298a7c3-676a-4c42-806f-f47c18e8097b for instance with vm_state deleted and task_state None.
Nov 27 05:08:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk /opt/stack/data/nova/instances/snapshots/tmpbje3xorl/86fa664247954bd299a495c13d8c0aa1" returned: 0 in 0.693s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:20 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Snapshot extracted, beginning image upload
Nov 27 05:08:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-e22cd358-2837-4855-8ddb-78e57a9f7667 req-ff1b31cb-fe99-435a-a3f4-4d68ea7d5dfd service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e22cd358-2837-4855-8ddb-78e57a9f7667 req-ff1b31cb-fe99-435a-a3f4-4d68ea7d5dfd service nova] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e22cd358-2837-4855-8ddb-78e57a9f7667 req-ff1b31cb-fe99-435a-a3f4-4d68ea7d5dfd service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e22cd358-2837-4855-8ddb-78e57a9f7667 req-ff1b31cb-fe99-435a-a3f4-4d68ea7d5dfd service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-e22cd358-2837-4855-8ddb-78e57a9f7667 req-ff1b31cb-fe99-435a-a3f4-4d68ea7d5dfd service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] No waiting events found dispatching network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:08:21 user nova-compute[75260]: WARNING nova.compute.manager [req-e22cd358-2837-4855-8ddb-78e57a9f7667 req-ff1b31cb-fe99-435a-a3f4-4d68ea7d5dfd service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received unexpected event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f for instance with vm_state active and task_state shelving_image_uploading.
Nov 27 05:08:21 user nova-compute[75260]: DEBUG nova.compute.manager [req-e22cd358-2837-4855-8ddb-78e57a9f7667 req-ff1b31cb-fe99-435a-a3f4-4d68ea7d5dfd service nova] [instance: 1b25e35f-08c6-46e6-8dd4-4a50a2028c33] Received event network-vif-deleted-9298a7c3-676a-4c42-806f-f47c18e8097b {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:23 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Snapshot image upload complete
Nov 27 05:08:23 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:08:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:23 user nova-compute[75260]: INFO nova.compute.manager [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Shelve offloading
Nov 27 05:08:24 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Instance destroyed successfully.
Nov 27 05:08:24 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:08:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:08:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquired lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:08:24 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:08:24 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updating instance_info_cache with network_info: [{"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:08:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Releasing lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:08:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Instance destroyed successfully.
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'resources' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662644095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662644095',id=45,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwTee5WzLqQhoRMA4sbX1fAotCAjpFJipUMi3g9gAfLEVR90Y0EtLbqHarpPBhAGLKQlbarxTVB1rw4RYU74yALs0GrJT/AUIoZcxScITh7PRun10sRS4g4yvN5SVkh0A==',key_name='tempest-keypair-730565496',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-5ynjblwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member',shelved_at='2023-11-27T05:08:23.891797',shelved_host='user',shelved_image_id='39baa204-919b-4a78-93b0-42ed95932505'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=d7e4e399-4234-498c-b87a-9ed75477e2b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG os_vif [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a757f70-bf, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=275e9cd6-47f2-43b4-97e2-cc7aaa9dc2b8) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-ba4d748f-035e-47a5-a2eb-6c5bb278e663 req-07b81b38-cde3-4090-a87e-b2c650f5eef4 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-changed-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-ba4d748f-035e-47a5-a2eb-6c5bb278e663 req-07b81b38-cde3-4090-a87e-b2c650f5eef4 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Refreshing instance network info cache due to event network-changed-3a757f70-bf6a-4b7b-b62c-adc9c158836f. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ba4d748f-035e-47a5-a2eb-6c5bb278e663 req-07b81b38-cde3-4090-a87e-b2c650f5eef4 service nova] Acquiring lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ba4d748f-035e-47a5-a2eb-6c5bb278e663 req-07b81b38-cde3-4090-a87e-b2c650f5eef4 service nova] Acquired lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.network.neutron [req-ba4d748f-035e-47a5-a2eb-6c5bb278e663 req-07b81b38-cde3-4090-a87e-b2c650f5eef4 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Refreshing network info cache for port 3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:08:25 user nova-compute[75260]: INFO os_vif [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf')
Nov 27 05:08:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Deleting instance files /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6_del
Nov 27 05:08:25 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Deletion of /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6_del complete
Nov 27 05:08:25 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Deleted allocations for instance d7e4e399-4234-498c-b87a-9ed75477e2b6
Nov 27 05:08:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'numa_topology' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.objects.base [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Object Instance<d7e4e399-4234-498c-b87a-9ed75477e2b6> lazy-loaded attributes: resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b5165dd7-3cb1-4cac-a561-82c1f948b332 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.600s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:26 user nova-compute[75260]: DEBUG nova.network.neutron [req-ba4d748f-035e-47a5-a2eb-6c5bb278e663 req-07b81b38-cde3-4090-a87e-b2c650f5eef4 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updated VIF entry in instance network info cache for port 3a757f70-bf6a-4b7b-b62c-adc9c158836f. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:08:26 user nova-compute[75260]: DEBUG nova.network.neutron [req-ba4d748f-035e-47a5-a2eb-6c5bb278e663 req-07b81b38-cde3-4090-a87e-b2c650f5eef4 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updating instance_info_cache with network_info: [{"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3a757f70-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:08:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ba4d748f-035e-47a5-a2eb-6c5bb278e663 req-07b81b38-cde3-4090-a87e-b2c650f5eef4 service nova] Releasing lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:08:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:08:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:44 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:08:44 user nova-compute[75260]: INFO nova.compute.claims [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Claim successful on node user
Nov 27 05:08:45 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:08:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:08:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG nova.policy [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e509f168517f4fef82ce3d34122fd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc3728cb2564827a26f40cbc0ec6b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:08:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Creating image(s)
Nov 27 05:08:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "/opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "/opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "/opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e.part --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Successfully created port: 69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG nova.virt.images [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] 40656e54-9be2-4df7-872a-8574b91ce35f was qcow2, converting to raw {{(pid=75260) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e.part /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e.converted {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e.part /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e.converted" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e.converted --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.097s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Successfully updated port: 69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-69757c2e-19f3-40b9-aa3d-4fb9a704bff6 req-0b469d67-6147-4f11-91be-28bd1fc8b22a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-changed-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-69757c2e-19f3-40b9-aa3d-4fb9a704bff6 req-0b469d67-6147-4f11-91be-28bd1fc8b22a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Refreshing instance network info cache due to event network-changed-69453649-30eb-4496-8d36-8bd29c9d20b1. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-69757c2e-19f3-40b9-aa3d-4fb9a704bff6 req-0b469d67-6147-4f11-91be-28bd1fc8b22a service nova] Acquiring lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-69757c2e-19f3-40b9-aa3d-4fb9a704bff6 req-0b469d67-6147-4f11-91be-28bd1fc8b22a service nova] Acquired lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG nova.network.neutron [req-69757c2e-19f3-40b9-aa3d-4fb9a704bff6 req-0b469d67-6147-4f11-91be-28bd1fc8b22a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Refreshing network info cache for port 69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG nova.network.neutron [req-69757c2e-19f3-40b9-aa3d-4fb9a704bff6 req-0b469d67-6147-4f11-91be-28bd1fc8b22a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e --force-share --output=json" returned: 0 in 0.182s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e,backing_fmt=raw /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e,backing_fmt=raw /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk 1073741824" returned: 0 in 0.050s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.network.neutron [req-69757c2e-19f3-40b9-aa3d-4fb9a704bff6 req-0b469d67-6147-4f11-91be-28bd1fc8b22a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-69757c2e-19f3-40b9-aa3d-4fb9a704bff6 req-0b469d67-6147-4f11-91be-28bd1fc8b22a service nova] Releasing lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquired lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Cannot resize image /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Ensure instance console log exists: /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating instance_info_cache with network_info: [{"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Releasing lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Instance network_info: |[{"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Start _get_guest_xml network_info=[{"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T05:08:42Z,direct_url=<?>,disk_format='qcow2',id=40656e54-9be2-4df7-872a-8574b91ce35f,min_disk=0,min_ram=0,name='tempest-scenario-img--1069120560',owner='1fc3728cb2564827a26f40cbc0ec6b5f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T05:08:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '40656e54-9be2-4df7-872a-8574b91ce35f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:08:47 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:08:47 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T05:08:42Z,direct_url=<?>,disk_format='qcow2',id=40656e54-9be2-4df7-872a-8574b91ce35f,min_disk=0,min_ram=0,name='tempest-scenario-img--1069120560',owner='1fc3728cb2564827a26f40cbc0ec6b5f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T05:08:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1023812160',display_name='tempest-TestMinimumBasicScenario-server-1023812160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1023812160',id=47,image_ref='40656e54-9be2-4df7-872a-8574b91ce35f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGcycZCJluOOI1EeFc+ciNXD49LdocCXMPQeIzQVs4Tgxu9qK5/ys7NbV/2rRzXqWbEQcGNR21/1ZdQLC+3axjBnMU0pnhXJMEQtX7rAhw9dfjYZzF7S0S3dvr7xk27+Q==',key_name='tempest-TestMinimumBasicScenario-1484888750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fc3728cb2564827a26f40cbc0ec6b5f',ramdisk_id='',reservation_id='r-119pb7ky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40656e54-9be2-4df7-872a-8574b91ce35f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-372834875',owner_user_name='tempest-TestMinimumBasicScenario-372834875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:08:45Z,user_data=None,user_id='e509f168517f4fef82ce3d34122fd59d',uuid=856b6b6c-c631-4d92-80f9-ae659a1c966b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converting VIF {"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ba:3b,bridge_name='br-int',has_traffic_filtering=True,id=69453649-30eb-4496-8d36-8bd29c9d20b1,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69453649-30') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.objects.instance [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'pci_devices' on Instance uuid 856b6b6c-c631-4d92-80f9-ae659a1c966b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:08:47 user nova-compute[75260]:   <uuid>856b6b6c-c631-4d92-80f9-ae659a1c966b</uuid>
Nov 27 05:08:47 user nova-compute[75260]:   <name>instance-0000002f</name>
Nov 27 05:08:47 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:08:47 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:08:47 user nova-compute[75260]:   <metadata>
Nov 27 05:08:47 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:08:47 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:08:47 user nova-compute[75260]:       <nova:name>tempest-TestMinimumBasicScenario-server-1023812160</nova:name>
Nov 27 05:08:47 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:08:47</nova:creationTime>
Nov 27 05:08:47 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:08:47 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:08:47 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:08:47 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:08:47 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:08:47 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:08:47 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:08:47 user nova-compute[75260]:       <nova:owner>
Nov 27 05:08:47 user nova-compute[75260]:         <nova:user uuid="e509f168517f4fef82ce3d34122fd59d">tempest-TestMinimumBasicScenario-372834875-project-member</nova:user>
Nov 27 05:08:47 user nova-compute[75260]:         <nova:project uuid="1fc3728cb2564827a26f40cbc0ec6b5f">tempest-TestMinimumBasicScenario-372834875</nova:project>
Nov 27 05:08:47 user nova-compute[75260]:       </nova:owner>
Nov 27 05:08:47 user nova-compute[75260]:       <nova:root type="image" uuid="40656e54-9be2-4df7-872a-8574b91ce35f"/>
Nov 27 05:08:47 user nova-compute[75260]:       <nova:ports>
Nov 27 05:08:47 user nova-compute[75260]:         <nova:port uuid="69453649-30eb-4496-8d36-8bd29c9d20b1">
Nov 27 05:08:47 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 05:08:47 user nova-compute[75260]:         </nova:port>
Nov 27 05:08:47 user nova-compute[75260]:       </nova:ports>
Nov 27 05:08:47 user nova-compute[75260]:     </nova:instance>
Nov 27 05:08:47 user nova-compute[75260]:   </metadata>
Nov 27 05:08:47 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:08:47 user nova-compute[75260]:     <system>
Nov 27 05:08:47 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:08:47 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:08:47 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:08:47 user nova-compute[75260]:       <entry name="serial">856b6b6c-c631-4d92-80f9-ae659a1c966b</entry>
Nov 27 05:08:47 user nova-compute[75260]:       <entry name="uuid">856b6b6c-c631-4d92-80f9-ae659a1c966b</entry>
Nov 27 05:08:47 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:08:47 user nova-compute[75260]:     </system>
Nov 27 05:08:47 user nova-compute[75260]:   </sysinfo>
Nov 27 05:08:47 user nova-compute[75260]:   <os>
Nov 27 05:08:47 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:08:47 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:08:47 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:08:47 user nova-compute[75260]:   </os>
Nov 27 05:08:47 user nova-compute[75260]:   <features>
Nov 27 05:08:47 user nova-compute[75260]:     <acpi/>
Nov 27 05:08:47 user nova-compute[75260]:     <apic/>
Nov 27 05:08:47 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:08:47 user nova-compute[75260]:   </features>
Nov 27 05:08:47 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:08:47 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:08:47 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:08:47 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:08:47 user nova-compute[75260]:   </clock>
Nov 27 05:08:47 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:08:47 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:08:47 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:08:47 user nova-compute[75260]:   </cpu>
Nov 27 05:08:47 user nova-compute[75260]:   <devices>
Nov 27 05:08:47 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 05:08:47 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 05:08:47 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk"/>
Nov 27 05:08:47 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:08:47 user nova-compute[75260]:     </disk>
Nov 27 05:08:47 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:08:47 user nova-compute[75260]:       <mac address="fa:16:3e:85:ba:3b"/>
Nov 27 05:08:47 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:08:47 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:08:47 user nova-compute[75260]:       <target dev="tap69453649-30"/>
Nov 27 05:08:47 user nova-compute[75260]:     </interface>
Nov 27 05:08:47 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:08:47 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/console.log" append="off"/>
Nov 27 05:08:47 user nova-compute[75260]:     </serial>
Nov 27 05:08:47 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:08:47 user nova-compute[75260]:     <video>
Nov 27 05:08:47 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:08:47 user nova-compute[75260]:     </video>
Nov 27 05:08:47 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:08:47 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:08:47 user nova-compute[75260]:     </rng>
Nov 27 05:08:47 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:08:47 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:08:47 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:08:47 user nova-compute[75260]:     </memballoon>
Nov 27 05:08:47 user nova-compute[75260]:   </devices>
Nov 27 05:08:47 user nova-compute[75260]: </domain>
Nov 27 05:08:47 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1023812160',display_name='tempest-TestMinimumBasicScenario-server-1023812160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1023812160',id=47,image_ref='40656e54-9be2-4df7-872a-8574b91ce35f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGcycZCJluOOI1EeFc+ciNXD49LdocCXMPQeIzQVs4Tgxu9qK5/ys7NbV/2rRzXqWbEQcGNR21/1ZdQLC+3axjBnMU0pnhXJMEQtX7rAhw9dfjYZzF7S0S3dvr7xk27+Q==',key_name='tempest-TestMinimumBasicScenario-1484888750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fc3728cb2564827a26f40cbc0ec6b5f',ramdisk_id='',reservation_id='r-119pb7ky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40656e54-9be2-4df7-872a-8574b91ce35f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-372834875',owner_user_name='tempest-TestMinimumBasicScenario-372834875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:08:45Z,user_data=None,user_id='e509f168517f4fef82ce3d34122fd59d',uuid=856b6b6c-c631-4d92-80f9-ae659a1c966b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converting VIF {"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:ba:3b,bridge_name='br-int',has_traffic_filtering=True,id=69453649-30eb-4496-8d36-8bd29c9d20b1,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69453649-30') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG os_vif [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ba:3b,bridge_name='br-int',has_traffic_filtering=True,id=69453649-30eb-4496-8d36-8bd29c9d20b1,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69453649-30') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b52ead0b-0dcd-57df-bff8-a1eeae85873a', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69453649-30, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69453649-30, col_values=(('qos', UUID('596e8647-9d33-48d4-bcf9-e205a64d22a3')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69453649-30, col_values=(('external_ids', {'iface-id': '69453649-30eb-4496-8d36-8bd29c9d20b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:ba:3b', 'vm-uuid': '856b6b6c-c631-4d92-80f9-ae659a1c966b'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:47 user nova-compute[75260]: INFO os_vif [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:ba:3b,bridge_name='br-int',has_traffic_filtering=True,id=69453649-30eb-4496-8d36-8bd29c9d20b1,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69453649-30')
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:08:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] No VIF found with MAC fa:16:3e:85:ba:3b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:08:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-4d064dc0-d9d6-495f-a8d0-5305572c8d36 req-d5a86234-6cba-4255-8df9-827edbd5122a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4d064dc0-d9d6-495f-a8d0-5305572c8d36 req-d5a86234-6cba-4255-8df9-827edbd5122a service nova] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4d064dc0-d9d6-495f-a8d0-5305572c8d36 req-d5a86234-6cba-4255-8df9-827edbd5122a service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4d064dc0-d9d6-495f-a8d0-5305572c8d36 req-d5a86234-6cba-4255-8df9-827edbd5122a service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-4d064dc0-d9d6-495f-a8d0-5305572c8d36 req-d5a86234-6cba-4255-8df9-827edbd5122a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] No waiting events found dispatching network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:08:49 user nova-compute[75260]: WARNING nova.compute.manager [req-4d064dc0-d9d6-495f-a8d0-5305572c8d36 req-d5a86234-6cba-4255-8df9-827edbd5122a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received unexpected event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 for instance with vm_state building and task_state spawning.
Nov 27 05:08:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:08:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:08:50 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Instance spawned successfully.
Nov 27 05:08:50 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-33e9ab77-55f9-4a4d-87ed-e22e804b53c9 req-d422975f-d381-49d4-b6e1-267f3dc36538 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-33e9ab77-55f9-4a4d-87ed-e22e804b53c9 req-d422975f-d381-49d4-b6e1-267f3dc36538 service nova] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-33e9ab77-55f9-4a4d-87ed-e22e804b53c9 req-d422975f-d381-49d4-b6e1-267f3dc36538 service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-33e9ab77-55f9-4a4d-87ed-e22e804b53c9 req-d422975f-d381-49d4-b6e1-267f3dc36538 service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-33e9ab77-55f9-4a4d-87ed-e22e804b53c9 req-d422975f-d381-49d4-b6e1-267f3dc36538 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] No waiting events found dispatching network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:08:51 user nova-compute[75260]: WARNING nova.compute.manager [req-33e9ab77-55f9-4a4d-87ed-e22e804b53c9 req-d422975f-d381-49d4-b6e1-267f3dc36538 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received unexpected event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 for instance with vm_state building and task_state spawning.
Nov 27 05:08:51 user nova-compute[75260]: INFO nova.compute.manager [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 27 05:08:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:08:51 user nova-compute[75260]: INFO nova.compute.manager [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Took 6.34 seconds to build instance.
Nov 27 05:08:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-b752efc5-9dce-4635-9b98-ec24be609919 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.455s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:08:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:08:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:08:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:08:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:08:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:08:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:03 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:09:04 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 05:09:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:09:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:09:05 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:09:05 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid c0f2d0d5-6181-4702-b582-0ab94adc8fc3 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:09:05 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updating instance_info_cache with network_info: [{"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:09:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:09:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:09:05 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:09:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:10 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:09:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:09:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:09:10 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:09:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:09:11 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:09:11 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:09:11 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=25.187049865722656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance c0f2d0d5-6181-4702-b582-0ab94adc8fc3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 856b6b6c-c631-4d92-80f9-ae659a1c966b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:09:11 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:09:12 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:09:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:09:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:09:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:09:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:09:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:09:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:09:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:09:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:09:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:09:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:09:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:09:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:09:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:09:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:09:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:09:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:09:53 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:09:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:09:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:09:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:09:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:09:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:09:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:09:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-06424b40-2a25-4468-8885-e8749129f089 req-b1c71864-55bc-4c0a-b00a-5edf8868e78e service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received event network-changed-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:09:58 user nova-compute[75260]: DEBUG nova.compute.manager [req-06424b40-2a25-4468-8885-e8749129f089 req-b1c71864-55bc-4c0a-b00a-5edf8868e78e service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Refreshing instance network info cache due to event network-changed-65596b71-101a-4ee5-82e8-45ea7fd38708. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:09:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-06424b40-2a25-4468-8885-e8749129f089 req-b1c71864-55bc-4c0a-b00a-5edf8868e78e service nova] Acquiring lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:09:58 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-06424b40-2a25-4468-8885-e8749129f089 req-b1c71864-55bc-4c0a-b00a-5edf8868e78e service nova] Acquired lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:09:58 user nova-compute[75260]: DEBUG nova.network.neutron [req-06424b40-2a25-4468-8885-e8749129f089 req-b1c71864-55bc-4c0a-b00a-5edf8868e78e service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Refreshing network info cache for port 65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:09:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-06424b40-2a25-4468-8885-e8749129f089 req-b1c71864-55bc-4c0a-b00a-5edf8868e78e service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updated VIF entry in instance network info cache for port 65596b71-101a-4ee5-82e8-45ea7fd38708. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:09:59 user nova-compute[75260]: DEBUG nova.network.neutron [req-06424b40-2a25-4468-8885-e8749129f089 req-b1c71864-55bc-4c0a-b00a-5edf8868e78e service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updating instance_info_cache with network_info: [{"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:09:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-06424b40-2a25-4468-8885-e8749129f089 req-b1c71864-55bc-4c0a-b00a-5edf8868e78e service nova] Releasing lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:09:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:03 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:05 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:10:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:05 user nova-compute[75260]: DEBUG nova.compute.manager [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:10:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:10:05 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:10:05 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:10:06 user nova-compute[75260]: INFO nova.compute.claims [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Claim successful on node user
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.compute.manager [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:10:06 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.compute.manager [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.network.neutron [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.compute.manager [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating instance_info_cache with network_info: [{"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:10:06 user nova-compute[75260]: INFO nova.virt.block_device [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Booting with volume snapshot d939c5e1-4e64-4f66-83a7-34a5299c6d3d at /dev/vda
Nov 27 05:10:06 user nova-compute[75260]: DEBUG nova.policy [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bbd9c9317ac4d34ad23932bb35bcc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b302e83cda4b6bacc8e613016c8189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Successfully created port: 9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Successfully updated port: 9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "refresh_cache-c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquired lock "refresh_cache-c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-4cc28cc9-93c9-41a1-8011-7cf00cc0bcc3 req-3a31adcb-147a-4e49-805b-54802fccaac3 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received event network-changed-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG nova.compute.manager [req-4cc28cc9-93c9-41a1-8011-7cf00cc0bcc3 req-3a31adcb-147a-4e49-805b-54802fccaac3 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Refreshing instance network info cache due to event network-changed-9782db4a-8431-44dc-ad9b-d0a581b86b44. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:10:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4cc28cc9-93c9-41a1-8011-7cf00cc0bcc3 req-3a31adcb-147a-4e49-805b-54802fccaac3 service nova] Acquiring lock "refresh_cache-c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:10:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Updating instance_info_cache with network_info: [{"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:10:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Releasing lock "refresh_cache-c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:10:08 user nova-compute[75260]: DEBUG nova.compute.manager [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Instance network_info: |[{"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:10:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4cc28cc9-93c9-41a1-8011-7cf00cc0bcc3 req-3a31adcb-147a-4e49-805b-54802fccaac3 service nova] Acquired lock "refresh_cache-c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:10:08 user nova-compute[75260]: DEBUG nova.network.neutron [req-4cc28cc9-93c9-41a1-8011-7cf00cc0bcc3 req-3a31adcb-147a-4e49-805b-54802fccaac3 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Refreshing network info cache for port 9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:10:08 user nova-compute[75260]: DEBUG nova.network.neutron [req-4cc28cc9-93c9-41a1-8011-7cf00cc0bcc3 req-3a31adcb-147a-4e49-805b-54802fccaac3 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Updated VIF entry in instance network info cache for port 9782db4a-8431-44dc-ad9b-d0a581b86b44. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:10:08 user nova-compute[75260]: DEBUG nova.network.neutron [req-4cc28cc9-93c9-41a1-8011-7cf00cc0bcc3 req-3a31adcb-147a-4e49-805b-54802fccaac3 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Updating instance_info_cache with network_info: [{"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:10:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4cc28cc9-93c9-41a1-8011-7cf00cc0bcc3 req-3a31adcb-147a-4e49-805b-54802fccaac3 service nova] Releasing lock "refresh_cache-c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:10:10 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:11 user nova-compute[75260]: INFO nova.compute.manager [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Unshelving
Nov 27 05:10:11 user nova-compute[75260]: INFO nova.virt.block_device [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Booting with volume da85b7e1-2451-493a-93b8-d70d6a8cf31f at /dev/vdc
Nov 27 05:10:11 user nova-compute[75260]: DEBUG os_brick.utils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.060s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc019f10-b9a5-4067-90dc-4049c72bc290]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[217ae5b0-9317-4da0-a1b9-cbb8727191cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c49921b-f51e-4bfe-9f7b-2300ff221a7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6c44d8-d0de-48ba-a53d-cec57580fb7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:10:11 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3787451f-9ff5-4aac-9517-b11013c9b0b6]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG os_brick.utils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updating existing volume attachment record: 551b9780-ce92-4e42-b27a-d6641864b33c {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:11 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG os_brick.utils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[74629815-8d22-4799-9a41-289d2ba498a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c062a63c-5b2d-4987-a502-5ff7eeeb4c47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb9a76-3394-4465-a94c-b282261dd423]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7b001c-dae5-4ea8-ba8c-6c69fbac4fea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:10:12 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bce383-a55a-454d-aa5b-adf6927ec9a6]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG os_brick.utils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Updating existing volume attachment record: a3de2e98-54a8-4646-bcb0-5b9247cd479f {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:12 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:10:12 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:10:12 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=25.182418823242188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance c0f2d0d5-6181-4702-b582-0ab94adc8fc3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 856b6b6c-c631-4d92-80f9-ae659a1c966b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance c310bdfe-2573-46b1-8a2e-f39ad9c1f55c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d7e4e399-4234-498c-b87a-9ed75477e2b6 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing inventories for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating ProviderTree inventory for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing aggregate associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, aggregates: None {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing trait associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:10:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.objects.instance [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'pci_requests' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.objects.instance [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'numa_topology' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:10:18 user nova-compute[75260]: INFO nova.compute.claims [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Claim successful on node user
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.compute.manager [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:10:18 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Creating image(s)
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Ensure instance console log exists: /opt/stack/data/nova/instances/c310bdfe-2573-46b1-8a2e-f39ad9c1f55c/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Start _get_guest_xml network_info=[{"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-27T05:10:01Z,direct_url=<?>,disk_format='qcow2',id=e02ff776-34e3-4810-b4bf-5021b3f21df6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-595827716',owner='c4b302e83cda4b6bacc8e613016c8189',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-27T05:10:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'a3de2e98-54a8-4646-bcb0-5b9247cd479f', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMfpWLqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c310bdfe-2573-46b1-8a2e-f39ad9c1f55c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba63eb27-1564-4855-82ba-02b65479c70c', 'serial': 'ba63eb27-1564-4855-82ba-02b65479c70c'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:18 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:10:18 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-27T05:10:01Z,direct_url=<?>,disk_format='qcow2',id=e02ff776-34e3-4810-b4bf-5021b3f21df6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-595827716',owner='c4b302e83cda4b6bacc8e613016c8189',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-27T05:10:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMfpWLqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:10:18 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:10:18 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:10:18 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68337c2-e260-485d-b0cf-866c76348a03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:10:18 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: INFO nova.network.neutron [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updating port 3a757f70-bf6a-4b7b-b62c-adc9c158836f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7312e536-85f3-482d-97ee-f199b888fe0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c] added
Nov 27 05:10:18 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5f7568-16e7-436b-b79a-c2e9c491a54c]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a79cfc-1fdd-4243-87ed-2540811a4a57]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMfpWLqb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMfpWLqb" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[876b9f59-ea96-46b7-865e-8899d15810bf]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tMfpWLqb'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca38065-a9d1-4f53-a7ed-f458998d16cf]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa69da5-9339-426d-a93c-81739717fada]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:18 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:18 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d760da-af01-4f2c-9a42-e1aa0a862763]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c, portal: 172.16.0.220,3260]
Nov 27 05:10:18 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c, portal: 172.16.0.220,3260] successful.
Nov 27 05:10:18 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf783e3-5a9d-43b6-9407-0e6a9cf4dfd4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7cbfa1-5661-4767-ab57-467f11399141]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:18 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:10:18 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:18 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:10:18 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[615fef7b-4493-4428-a1bd-efa2c4f66be2]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:10:18 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMfpWLqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquired lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG nova.network.neutron [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-53d6f72a-2fbc-46c5-a43c-b40f3c22817a req-f4ee58cb-fa71-48a5-be5f-4ab261b59764 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-changed-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG nova.compute.manager [req-53d6f72a-2fbc-46c5-a43c-b40f3c22817a req-f4ee58cb-fa71-48a5-be5f-4ab261b59764 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Refreshing instance network info cache due to event network-changed-3a757f70-bf6a-4b7b-b62c-adc9c158836f. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-53d6f72a-2fbc-46c5-a43c-b40f3c22817a req-f4ee58cb-fa71-48a5-be5f-4ab261b59764 service nova] Acquiring lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG nova.network.neutron [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updating instance_info_cache with network_info: [{"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Releasing lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:10:19 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Creating image(s)
Nov 27 05:10:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "/opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "/opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG nova.objects.instance [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'trusted_certs' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-53d6f72a-2fbc-46c5-a43c-b40f3c22817a req-f4ee58cb-fa71-48a5-be5f-4ab261b59764 service nova] Acquired lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG nova.network.neutron [req-53d6f72a-2fbc-46c5-a43c-b40f3c22817a req-f4ee58cb-fa71-48a5-be5f-4ab261b59764 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Refreshing network info cache for port 3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG nova.objects.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Object Instance<d7e4e399-4234-498c-b87a-9ed75477e2b6> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "91d155b6214398affe7a13146195cb822a90017d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "91d155b6214398affe7a13146195cb822a90017d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d.part --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.120s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== connect_volume: return (2123ms) {'type': 'block', 'scsi_wwn': '23761653632616233', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761653632616233', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1867659401',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1867659401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1867659401',id=48,image_ref='e02ff776-34e3-4810-b4bf-5021b3f21df6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhf4P+4AgTIjOPjFb1PFoApXwVhG59Ih5hxl52c/8xEnL/U829dHLW4nHLPl0kNzgSSe9TeEd/GvwkwKuq3f8PehxdKtXqHizIId1KLwIzm7fQH8pqvNVLjV5Hegpa3Mg==',key_name='tempest-keypair-1745859104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-5v9zfjz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1806325901',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=c310bdfe-2573-46b1-8a2e-f39ad9c1f55c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6b:68,bridge_name='br-int',has_traffic_filtering=True,id=9782db4a-8431-44dc-ad9b-d0a581b86b44,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9782db4a-84') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.objects.instance [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'pci_devices' on Instance uuid c310bdfe-2573-46b1-8a2e-f39ad9c1f55c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:10:20 user nova-compute[75260]:   <uuid>c310bdfe-2573-46b1-8a2e-f39ad9c1f55c</uuid>
Nov 27 05:10:20 user nova-compute[75260]:   <name>instance-00000030</name>
Nov 27 05:10:20 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:10:20 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:10:20 user nova-compute[75260]:   <metadata>
Nov 27 05:10:20 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:10:20 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:10:20 user nova-compute[75260]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1867659401</nova:name>
Nov 27 05:10:20 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:10:18</nova:creationTime>
Nov 27 05:10:20 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:10:20 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:10:20 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:10:20 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:10:20 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:10:20 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:10:20 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:10:20 user nova-compute[75260]:       <nova:owner>
Nov 27 05:10:20 user nova-compute[75260]:         <nova:user uuid="5bbd9c9317ac4d34ad23932bb35bcc87">tempest-TestVolumeBootPattern-1806325901-project-member</nova:user>
Nov 27 05:10:20 user nova-compute[75260]:         <nova:project uuid="c4b302e83cda4b6bacc8e613016c8189">tempest-TestVolumeBootPattern-1806325901</nova:project>
Nov 27 05:10:20 user nova-compute[75260]:       </nova:owner>
Nov 27 05:10:20 user nova-compute[75260]:       <nova:root type="image" uuid="e02ff776-34e3-4810-b4bf-5021b3f21df6"/>
Nov 27 05:10:20 user nova-compute[75260]:       <nova:ports>
Nov 27 05:10:20 user nova-compute[75260]:         <nova:port uuid="9782db4a-8431-44dc-ad9b-d0a581b86b44">
Nov 27 05:10:20 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 05:10:20 user nova-compute[75260]:         </nova:port>
Nov 27 05:10:20 user nova-compute[75260]:       </nova:ports>
Nov 27 05:10:20 user nova-compute[75260]:     </nova:instance>
Nov 27 05:10:20 user nova-compute[75260]:   </metadata>
Nov 27 05:10:20 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:10:20 user nova-compute[75260]:     <system>
Nov 27 05:10:20 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:10:20 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:10:20 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:10:20 user nova-compute[75260]:       <entry name="serial">c310bdfe-2573-46b1-8a2e-f39ad9c1f55c</entry>
Nov 27 05:10:20 user nova-compute[75260]:       <entry name="uuid">c310bdfe-2573-46b1-8a2e-f39ad9c1f55c</entry>
Nov 27 05:10:20 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:10:20 user nova-compute[75260]:     </system>
Nov 27 05:10:20 user nova-compute[75260]:   </sysinfo>
Nov 27 05:10:20 user nova-compute[75260]:   <os>
Nov 27 05:10:20 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:10:20 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:10:20 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:10:20 user nova-compute[75260]:   </os>
Nov 27 05:10:20 user nova-compute[75260]:   <features>
Nov 27 05:10:20 user nova-compute[75260]:     <acpi/>
Nov 27 05:10:20 user nova-compute[75260]:     <apic/>
Nov 27 05:10:20 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:10:20 user nova-compute[75260]:   </features>
Nov 27 05:10:20 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:10:20 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:10:20 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:10:20 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:10:20 user nova-compute[75260]:   </clock>
Nov 27 05:10:20 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:10:20 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:10:20 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:10:20 user nova-compute[75260]:   </cpu>
Nov 27 05:10:20 user nova-compute[75260]:   <devices>
Nov 27 05:10:20 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:10:20 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:10:20 user nova-compute[75260]:       <source dev="/dev/sdc"/>
Nov 27 05:10:20 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:10:20 user nova-compute[75260]:       <serial>ba63eb27-1564-4855-82ba-02b65479c70c</serial>
Nov 27 05:10:20 user nova-compute[75260]:     </disk>
Nov 27 05:10:20 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:10:20 user nova-compute[75260]:       <mac address="fa:16:3e:e1:6b:68"/>
Nov 27 05:10:20 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:10:20 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:10:20 user nova-compute[75260]:       <target dev="tap9782db4a-84"/>
Nov 27 05:10:20 user nova-compute[75260]:     </interface>
Nov 27 05:10:20 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:10:20 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/c310bdfe-2573-46b1-8a2e-f39ad9c1f55c/console.log" append="off"/>
Nov 27 05:10:20 user nova-compute[75260]:     </serial>
Nov 27 05:10:20 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:10:20 user nova-compute[75260]:     <video>
Nov 27 05:10:20 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:10:20 user nova-compute[75260]:     </video>
Nov 27 05:10:20 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:10:20 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:10:20 user nova-compute[75260]:     </rng>
Nov 27 05:10:20 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:10:20 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:10:20 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:10:20 user nova-compute[75260]:     </memballoon>
Nov 27 05:10:20 user nova-compute[75260]:   </devices>
Nov 27 05:10:20 user nova-compute[75260]: </domain>
Nov 27 05:10:20 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1867659401',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1867659401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1867659401',id=48,image_ref='e02ff776-34e3-4810-b4bf-5021b3f21df6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhf4P+4AgTIjOPjFb1PFoApXwVhG59Ih5hxl52c/8xEnL/U829dHLW4nHLPl0kNzgSSe9TeEd/GvwkwKuq3f8PehxdKtXqHizIId1KLwIzm7fQH8pqvNVLjV5Hegpa3Mg==',key_name='tempest-keypair-1745859104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-5v9zfjz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1806325901',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=c310bdfe-2573-46b1-8a2e-f39ad9c1f55c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6b:68,bridge_name='br-int',has_traffic_filtering=True,id=9782db4a-8431-44dc-ad9b-d0a581b86b44,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9782db4a-84') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG os_vif [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6b:68,bridge_name='br-int',has_traffic_filtering=True,id=9782db4a-8431-44dc-ad9b-d0a581b86b44,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9782db4a-84') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80d68eee-8883-5453-b2e4-01876efb8edd', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9782db4a-84, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9782db4a-84, col_values=(('qos', UUID('f159edf3-9f43-4b02-8235-8504fafa71db')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9782db4a-84, col_values=(('external_ids', {'iface-id': '9782db4a-8431-44dc-ad9b-d0a581b86b44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:6b:68', 'vm-uuid': 'c310bdfe-2573-46b1-8a2e-f39ad9c1f55c'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:20 user nova-compute[75260]: INFO os_vif [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6b:68,bridge_name='br-int',has_traffic_filtering=True,id=9782db4a-8431-44dc-ad9b-d0a581b86b44,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9782db4a-84')
Nov 27 05:10:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.virt.images [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] 39baa204-919b-4a78-93b0-42ed95932505 was qcow2, converting to raw {{(pid=75260) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d.part /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d.converted {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No VIF found with MAC fa:16:3e:e1:6b:68, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.network.neutron [req-53d6f72a-2fbc-46c5-a43c-b40f3c22817a req-f4ee58cb-fa71-48a5-be5f-4ab261b59764 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updated VIF entry in instance network info cache for port 3a757f70-bf6a-4b7b-b62c-adc9c158836f. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG nova.network.neutron [req-53d6f72a-2fbc-46c5-a43c-b40f3c22817a req-f4ee58cb-fa71-48a5-be5f-4ab261b59764 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updating instance_info_cache with network_info: [{"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:10:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-53d6f72a-2fbc-46c5-a43c-b40f3c22817a req-f4ee58cb-fa71-48a5-be5f-4ab261b59764 service nova] Releasing lock "refresh_cache-d7e4e399-4234-498c-b87a-9ed75477e2b6" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d.part /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d.converted" returned: 0 in 0.498s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d.converted --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "91d155b6214398affe7a13146195cb822a90017d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.923s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d --force-share --output=json" returned: 0 in 0.168s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "91d155b6214398affe7a13146195cb822a90017d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "91d155b6214398affe7a13146195cb822a90017d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d --force-share --output=json" returned: 0 in 0.175s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d,backing_fmt=raw /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d,backing_fmt=raw /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk 1073741824" returned: 0 in 0.062s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "91d155b6214398affe7a13146195cb822a90017d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:21 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG nova.objects.instance [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'migration_context' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG nova.objects.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Object Instance<d7e4e399-4234-498c-b87a-9ed75477e2b6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:10:22 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Rebasing disk image.
Nov 27 05:10:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.193s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 -F raw /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-9d35db1a-ab51-440a-ae02-3d51cfe21ebd req-acaa31c8-9c26-46b8-8e15-6d3205fb1917 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received event network-vif-plugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9d35db1a-ab51-440a-ae02-3d51cfe21ebd req-acaa31c8-9c26-46b8-8e15-6d3205fb1917 service nova] Acquiring lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9d35db1a-ab51-440a-ae02-3d51cfe21ebd req-acaa31c8-9c26-46b8-8e15-6d3205fb1917 service nova] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9d35db1a-ab51-440a-ae02-3d51cfe21ebd req-acaa31c8-9c26-46b8-8e15-6d3205fb1917 service nova] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG nova.compute.manager [req-9d35db1a-ab51-440a-ae02-3d51cfe21ebd req-acaa31c8-9c26-46b8-8e15-6d3205fb1917 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] No waiting events found dispatching network-vif-plugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:10:22 user nova-compute[75260]: WARNING nova.compute.manager [req-9d35db1a-ab51-440a-ae02-3d51cfe21ebd req-acaa31c8-9c26-46b8-8e15-6d3205fb1917 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received unexpected event network-vif-plugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 for instance with vm_state building and task_state spawning.
Nov 27 05:10:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:22 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75260) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.compute.manager [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:10:24 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Instance spawned successfully.
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:10:24 user nova-compute[75260]: INFO nova.compute.manager [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.compute.manager [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-b58f7727-0aab-43ca-b56a-c774f497db0f req-41a53885-6e11-46a4-be5f-8196d95f5a21 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received event network-vif-plugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b58f7727-0aab-43ca-b56a-c774f497db0f req-41a53885-6e11-46a4-be5f-8196d95f5a21 service nova] Acquiring lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b58f7727-0aab-43ca-b56a-c774f497db0f req-41a53885-6e11-46a4-be5f-8196d95f5a21 service nova] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b58f7727-0aab-43ca-b56a-c774f497db0f req-41a53885-6e11-46a4-be5f-8196d95f5a21 service nova] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-b58f7727-0aab-43ca-b56a-c774f497db0f req-41a53885-6e11-46a4-be5f-8196d95f5a21 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] No waiting events found dispatching network-vif-plugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:10:24 user nova-compute[75260]: WARNING nova.compute.manager [req-b58f7727-0aab-43ca-b56a-c774f497db0f req-41a53885-6e11-46a4-be5f-8196d95f5a21 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received unexpected event network-vif-plugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 for instance with vm_state building and task_state spawning.
Nov 27 05:10:24 user nova-compute[75260]: INFO nova.compute.manager [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Took 18.62 seconds to build instance.
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-86c6be23-cd76-42f7-85aa-8cfc9098b5fd tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.721s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 -F raw /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk" returned: 0 in 2.498s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Ensure instance console log exists: /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Start _get_guest_xml network_info=[{"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d6c0b4c0cc899769e39ac367b9463c5c',container_format='bare',created_at=2023-11-27T05:08:19Z,direct_url=<?>,disk_format='qcow2',id=39baa204-919b-4a78-93b0-42ed95932505,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-662644095-shelved',owner='c1ba48818d9d412da1471e0f56125dec',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-27T05:08:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': '551b9780-ce92-4e42-b27a-d6641864b33c', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEHqwYbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd7e4e399-4234-498c-b87a-9ed75477e2b6', 'attached_at': '', 'detached_at': '', 'volume_id': 'da85b7e1-2451-493a-93b8-d70d6a8cf31f', 'serial': 'da85b7e1-2451-493a-93b8-d70d6a8cf31f'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': None, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:10:24 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:10:24 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d6c0b4c0cc899769e39ac367b9463c5c',container_format='bare',created_at=2023-11-27T05:08:19Z,direct_url=<?>,disk_format='qcow2',id=39baa204-919b-4a78-93b0-42ed95932505,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-662644095-shelved',owner='c1ba48818d9d412da1471e0f56125dec',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-27T05:08:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.objects.instance [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'vcpu_model' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.objects.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Object Instance<d7e4e399-4234-498c-b87a-9ed75477e2b6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEHqwYbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:10:24 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:10:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:10:24 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:10:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:10:24 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aaf8fa-f956-4aeb-b077-cf862f2dcdf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:10:24 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0be6323-a672-46bc-a00a-e0f09b9eb104]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f] added
Nov 27 05:10:24 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:24 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b765f98f-b053-4525-8885-233feeae5038]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bb5956-be1b-4f2a-983e-65fa92aa7c50]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cEHqwYbG {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cEHqwYbG" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a0e129-0b57-44ab-8c8e-2960687e92df]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cEHqwYbG'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8b9e29-91c6-425b-a6fb-5b3cc0ce3a68]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcdc943-800d-4e02-8e82-988665604a3a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:25 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:10:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:25 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:10:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[10192e8e-b6e2-407e-94c7-34fc7dd31cc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f, portal: 172.16.0.220,3260]
Nov 27 05:10:25 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f, portal: 172.16.0.220,3260] successful.
Nov 27 05:10:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a15d2d5-fe21-416f-bed7-e560b5fc3afe]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce787d0f-1e90-4bef-bf54-7fee4d2bec45]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:25 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:10:25 user nova-compute[75260]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)
Nov 27 05:10:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:25 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:10:25 user nova-compute[75260]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)
Nov 27 05:10:25 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec48c268-20f4-4e78-834f-ce964b2a6805]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEHqwYbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 05:10:25 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] There are 0 instances to clean {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26566323932353562', 'path': '/dev/sdd'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566323932353562', 'path': '/dev/sdd'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T05:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662644095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662644095',id=45,image_ref='39baa204-919b-4a78-93b0-42ed95932505',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-730565496',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-5ynjblwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member',shelved_at='2023-11-27T05:08:23.891797',shelved_host='user',shelved_image_id='39baa204-919b-4a78-93b0-42ed95932505'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=d7e4e399-4234-498c-b87a-9ed75477e2b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.objects.instance [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'pci_devices' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.objects.base [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Object Instance<d7e4e399-4234-498c-b87a-9ed75477e2b6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:10:26 user nova-compute[75260]:   <uuid>d7e4e399-4234-498c-b87a-9ed75477e2b6</uuid>
Nov 27 05:10:26 user nova-compute[75260]:   <name>instance-0000002d</name>
Nov 27 05:10:26 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:10:26 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:10:26 user nova-compute[75260]:   <metadata>
Nov 27 05:10:26 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:10:26 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:10:26 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-662644095</nova:name>
Nov 27 05:10:26 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:10:24</nova:creationTime>
Nov 27 05:10:26 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:10:26 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:10:26 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:10:26 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:10:26 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:10:26 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:10:26 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:10:26 user nova-compute[75260]:       <nova:owner>
Nov 27 05:10:26 user nova-compute[75260]:         <nova:user uuid="0bfa8522667f4592bc4bfb0712b6b1f7">tempest-AttachVolumeShelveTestJSON-1008190038-project-member</nova:user>
Nov 27 05:10:26 user nova-compute[75260]:         <nova:project uuid="c1ba48818d9d412da1471e0f56125dec">tempest-AttachVolumeShelveTestJSON-1008190038</nova:project>
Nov 27 05:10:26 user nova-compute[75260]:       </nova:owner>
Nov 27 05:10:26 user nova-compute[75260]:       <nova:root type="image" uuid="39baa204-919b-4a78-93b0-42ed95932505"/>
Nov 27 05:10:26 user nova-compute[75260]:       <nova:ports>
Nov 27 05:10:26 user nova-compute[75260]:         <nova:port uuid="3a757f70-bf6a-4b7b-b62c-adc9c158836f">
Nov 27 05:10:26 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 05:10:26 user nova-compute[75260]:         </nova:port>
Nov 27 05:10:26 user nova-compute[75260]:       </nova:ports>
Nov 27 05:10:26 user nova-compute[75260]:     </nova:instance>
Nov 27 05:10:26 user nova-compute[75260]:   </metadata>
Nov 27 05:10:26 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:10:26 user nova-compute[75260]:     <system>
Nov 27 05:10:26 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:10:26 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:10:26 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:10:26 user nova-compute[75260]:       <entry name="serial">d7e4e399-4234-498c-b87a-9ed75477e2b6</entry>
Nov 27 05:10:26 user nova-compute[75260]:       <entry name="uuid">d7e4e399-4234-498c-b87a-9ed75477e2b6</entry>
Nov 27 05:10:26 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:10:26 user nova-compute[75260]:     </system>
Nov 27 05:10:26 user nova-compute[75260]:   </sysinfo>
Nov 27 05:10:26 user nova-compute[75260]:   <os>
Nov 27 05:10:26 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:10:26 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:10:26 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:10:26 user nova-compute[75260]:   </os>
Nov 27 05:10:26 user nova-compute[75260]:   <features>
Nov 27 05:10:26 user nova-compute[75260]:     <acpi/>
Nov 27 05:10:26 user nova-compute[75260]:     <apic/>
Nov 27 05:10:26 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:10:26 user nova-compute[75260]:   </features>
Nov 27 05:10:26 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:10:26 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:10:26 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:10:26 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:10:26 user nova-compute[75260]:   </clock>
Nov 27 05:10:26 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:10:26 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:10:26 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:10:26 user nova-compute[75260]:   </cpu>
Nov 27 05:10:26 user nova-compute[75260]:   <devices>
Nov 27 05:10:26 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 05:10:26 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 05:10:26 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk"/>
Nov 27 05:10:26 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:10:26 user nova-compute[75260]:     </disk>
Nov 27 05:10:26 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:10:26 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:10:26 user nova-compute[75260]:       <source dev="/dev/sdd"/>
Nov 27 05:10:26 user nova-compute[75260]:       <target dev="vdc" bus="virtio"/>
Nov 27 05:10:26 user nova-compute[75260]:       <serial>da85b7e1-2451-493a-93b8-d70d6a8cf31f</serial>
Nov 27 05:10:26 user nova-compute[75260]:     </disk>
Nov 27 05:10:26 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:10:26 user nova-compute[75260]:       <mac address="fa:16:3e:30:3a:73"/>
Nov 27 05:10:26 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:10:26 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:10:26 user nova-compute[75260]:       <target dev="tap3a757f70-bf"/>
Nov 27 05:10:26 user nova-compute[75260]:     </interface>
Nov 27 05:10:26 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:10:26 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/console.log" append="off"/>
Nov 27 05:10:26 user nova-compute[75260]:     </serial>
Nov 27 05:10:26 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:10:26 user nova-compute[75260]:     <video>
Nov 27 05:10:26 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:10:26 user nova-compute[75260]:     </video>
Nov 27 05:10:26 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:10:26 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:10:26 user nova-compute[75260]:     </rng>
Nov 27 05:10:26 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:10:26 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:10:26 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:10:26 user nova-compute[75260]:     </memballoon>
Nov 27 05:10:26 user nova-compute[75260]:   </devices>
Nov 27 05:10:26 user nova-compute[75260]: </domain>
Nov 27 05:10:26 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T05:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662644095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662644095',id=45,image_ref='39baa204-919b-4a78-93b0-42ed95932505',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-730565496',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-5ynjblwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member',shelved_at='2023-11-27T05:08:23.891797',shelved_host='user',shelved_image_id='39baa204-919b-4a78-93b0-42ed95932505'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=d7e4e399-4234-498c-b87a-9ed75477e2b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG os_vif [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1de97e41-aacf-5d22-a421-e440d2ff0fde', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a757f70-bf, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a757f70-bf, col_values=(('qos', UUID('349908e0-5a5e-4fb5-9aaa-f434c551ddc0')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a757f70-bf, col_values=(('external_ids', {'iface-id': '3a757f70-bf6a-4b7b-b62c-adc9c158836f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:3a:73', 'vm-uuid': 'd7e4e399-4234-498c-b87a-9ed75477e2b6'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:26 user nova-compute[75260]: INFO os_vif [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf')
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:10:26 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] No VIF found with MAC fa:16:3e:30:3a:73, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:10:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-7b7dc88e-a8c2-4c3c-baeb-cbd479a3367c req-ab78c43c-8823-437e-8125-fdd4b834b0af service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7b7dc88e-a8c2-4c3c-baeb-cbd479a3367c req-ab78c43c-8823-437e-8125-fdd4b834b0af service nova] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7b7dc88e-a8c2-4c3c-baeb-cbd479a3367c req-ab78c43c-8823-437e-8125-fdd4b834b0af service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7b7dc88e-a8c2-4c3c-baeb-cbd479a3367c req-ab78c43c-8823-437e-8125-fdd4b834b0af service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-7b7dc88e-a8c2-4c3c-baeb-cbd479a3367c req-ab78c43c-8823-437e-8125-fdd4b834b0af service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] No waiting events found dispatching network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:10:27 user nova-compute[75260]: WARNING nova.compute.manager [req-7b7dc88e-a8c2-4c3c-baeb-cbd479a3367c req-ab78c43c-8823-437e-8125-fdd4b834b0af service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received unexpected event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 05:10:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-e4b3d9b6-b8c5-4507-83be-9f749f7a3009 req-3d7c011e-8b85-4efb-a4dc-382ccdc465db service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e4b3d9b6-b8c5-4507-83be-9f749f7a3009 req-3d7c011e-8b85-4efb-a4dc-382ccdc465db service nova] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e4b3d9b6-b8c5-4507-83be-9f749f7a3009 req-3d7c011e-8b85-4efb-a4dc-382ccdc465db service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e4b3d9b6-b8c5-4507-83be-9f749f7a3009 req-3d7c011e-8b85-4efb-a4dc-382ccdc465db service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-e4b3d9b6-b8c5-4507-83be-9f749f7a3009 req-3d7c011e-8b85-4efb-a4dc-382ccdc465db service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] No waiting events found dispatching network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:10:30 user nova-compute[75260]: WARNING nova.compute.manager [req-e4b3d9b6-b8c5-4507-83be-9f749f7a3009 req-3d7c011e-8b85-4efb-a4dc-382ccdc465db service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received unexpected event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 05:10:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:10:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:10:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Instance spawned successfully.
Nov 27 05:10:30 user nova-compute[75260]: DEBUG nova.compute.manager [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:10:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-00fb4171-e79a-4099-80cd-02c9af9406a2 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.859s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG nova.objects.instance [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'flavor' on Instance uuid 856b6b6c-c631-4d92-80f9-ae659a1c966b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:38 user nova-compute[75260]: INFO nova.compute.manager [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Attaching volume f5ded4ef-7725-4a7c-8759-a521ffeae4ec to /dev/vdb
Nov 27 05:10:38 user nova-compute[75260]: DEBUG os_brick.utils [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc2fe6c-f82f-4dca-89b1-c71d18cfe3d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[32592eef-76bf-4e34-ad28-ab4bffdd69ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d861e6-e108-4266-a471-93b2a02cd551]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae50f269-899d-40d5-ab8b-1266cfc16743]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:10:38 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:10:38 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[97667258-9094-4d86-8a76-55e50bc6fec3]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG os_brick.utils [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:10:38 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating existing volume attachment record: 23fe9744-2395-4d9d-be9e-a127343842d8 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:10:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:10:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDgdqFJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:10:44 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:10:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:10:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:10:44 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:10:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:10:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:10:44 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:10:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c93fe5-dcc5-474a-85ab-f500c863b628]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:10:45 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[32084c05-526a-4f74-b8f9-ba4faa7a751b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec] added
Nov 27 05:10:45 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[363761bb-91b5-4758-b22e-c91d4ef7e3e8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6616e25e-619e-4b70-9d99-3d2a5bae4cb8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDgdqFJM {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDgdqFJM" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d078c9-f94b-40fb-946d-157a478c3a50]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rDgdqFJM'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9878bc9-7812-41c4-bad6-e5d1c70f44ae]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b59de01-af4f-45cb-a400-36d2cacf6dcc]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:45 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:10:45 user nova-compute[75260]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)
Nov 27 05:10:45 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:45 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:10:45 user nova-compute[75260]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)
Nov 27 05:10:45 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[967a56b2-a672-472e-8072-8e2c4c6331be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec, portal: 172.16.0.220,3260]
Nov 27 05:10:45 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec, portal: 172.16.0.220,3260] successful.
Nov 27 05:10:45 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[261350eb-8249-411b-a423-5772840d9b1f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5293542f-8987-4b26-9bd4-e362a6287c06]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:45 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:10:45 user nova-compute[75260]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)
Nov 27 05:10:45 user nova-compute[75260]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)
Nov 27 05:10:45 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:10:45 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:10:45 user nova-compute[75260]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)
Nov 27 05:10:45 user nova-compute[75260]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)
Nov 27 05:10:45 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] HCTL ('36', '-', '-', 0) found on session 59 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[154836c4-b7b6-4a47-ade4-47281fcf6eff]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Searching for a device in session 59 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:10:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDgdqFJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:10:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:10:46 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23962643866393236', 'path': '/dev/sde'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:10:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962643866393236', 'path': '/dev/sde'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:10:46 user nova-compute[75260]: DEBUG nova.objects.instance [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'flavor' on Instance uuid 856b6b6c-c631-4d92-80f9-ae659a1c966b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:10:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 05:10:46 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:10:46 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 05:10:46 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:10:46 user nova-compute[75260]:   <serial>f5ded4ef-7725-4a7c-8759-a521ffeae4ec</serial>
Nov 27 05:10:46 user nova-compute[75260]: </disk>
Nov 27 05:10:46 user nova-compute[75260]:  {{(pid=75260) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 05:10:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:10:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:10:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] No VIF found with MAC fa:16:3e:85:ba:3b, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:10:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-422aa92a-2f1a-413f-bab1-cb4fd7110ed6 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.340s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-9d884a08-cbca-4fab-ad31-88852f7b44ae req-d0e3d0f8-acc0-4c4b-986b-f8924b977e7a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-changed-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-9d884a08-cbca-4fab-ad31-88852f7b44ae req-d0e3d0f8-acc0-4c4b-986b-f8924b977e7a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Refreshing instance network info cache due to event network-changed-69453649-30eb-4496-8d36-8bd29c9d20b1. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:10:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9d884a08-cbca-4fab-ad31-88852f7b44ae req-d0e3d0f8-acc0-4c4b-986b-f8924b977e7a service nova] Acquiring lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:10:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9d884a08-cbca-4fab-ad31-88852f7b44ae req-d0e3d0f8-acc0-4c4b-986b-f8924b977e7a service nova] Acquired lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:10:49 user nova-compute[75260]: DEBUG nova.network.neutron [req-9d884a08-cbca-4fab-ad31-88852f7b44ae req-d0e3d0f8-acc0-4c4b-986b-f8924b977e7a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Refreshing network info cache for port 69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:10:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:50 user nova-compute[75260]: DEBUG nova.network.neutron [req-9d884a08-cbca-4fab-ad31-88852f7b44ae req-d0e3d0f8-acc0-4c4b-986b-f8924b977e7a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updated VIF entry in instance network info cache for port 69453649-30eb-4496-8d36-8bd29c9d20b1. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:10:50 user nova-compute[75260]: DEBUG nova.network.neutron [req-9d884a08-cbca-4fab-ad31-88852f7b44ae req-d0e3d0f8-acc0-4c4b-986b-f8924b977e7a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating instance_info_cache with network_info: [{"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:10:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9d884a08-cbca-4fab-ad31-88852f7b44ae req-d0e3d0f8-acc0-4c4b-986b-f8924b977e7a service nova] Releasing lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:10:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-e051e550-62b8-405a-b485-749765dc647d req-277c9ae4-5492-4f35-ab22-ba43b269b04f service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-changed-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-e051e550-62b8-405a-b485-749765dc647d req-277c9ae4-5492-4f35-ab22-ba43b269b04f service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Refreshing instance network info cache due to event network-changed-69453649-30eb-4496-8d36-8bd29c9d20b1. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:10:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e051e550-62b8-405a-b485-749765dc647d req-277c9ae4-5492-4f35-ab22-ba43b269b04f service nova] Acquiring lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:10:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e051e550-62b8-405a-b485-749765dc647d req-277c9ae4-5492-4f35-ab22-ba43b269b04f service nova] Acquired lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:10:51 user nova-compute[75260]: DEBUG nova.network.neutron [req-e051e550-62b8-405a-b485-749765dc647d req-277c9ae4-5492-4f35-ab22-ba43b269b04f service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Refreshing network info cache for port 69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:52 user nova-compute[75260]: INFO nova.compute.manager [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Rebooting instance
Nov 27 05:10:52 user nova-compute[75260]: DEBUG nova.network.neutron [req-e051e550-62b8-405a-b485-749765dc647d req-277c9ae4-5492-4f35-ab22-ba43b269b04f service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updated VIF entry in instance network info cache for port 69453649-30eb-4496-8d36-8bd29c9d20b1. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG nova.network.neutron [req-e051e550-62b8-405a-b485-749765dc647d req-277c9ae4-5492-4f35-ab22-ba43b269b04f service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating instance_info_cache with network_info: [{"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e051e550-62b8-405a-b485-749765dc647d req-277c9ae4-5492-4f35-ab22-ba43b269b04f service nova] Releasing lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquired lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating instance_info_cache with network_info: [{"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Releasing lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:10:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-6543340d-8781-4528-994c-1c85f1cafd0c req-f64a486b-f490-46d1-b64b-02b8296ce918 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-vif-unplugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6543340d-8781-4528-994c-1c85f1cafd0c req-f64a486b-f490-46d1-b64b-02b8296ce918 service nova] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6543340d-8781-4528-994c-1c85f1cafd0c req-f64a486b-f490-46d1-b64b-02b8296ce918 service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:55 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6543340d-8781-4528-994c-1c85f1cafd0c req-f64a486b-f490-46d1-b64b-02b8296ce918 service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-6543340d-8781-4528-994c-1c85f1cafd0c req-f64a486b-f490-46d1-b64b-02b8296ce918 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] No waiting events found dispatching network-vif-unplugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:10:55 user nova-compute[75260]: WARNING nova.compute.manager [req-6543340d-8781-4528-994c-1c85f1cafd0c req-f64a486b-f490-46d1-b64b-02b8296ce918 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received unexpected event network-vif-unplugged-69453649-30eb-4496-8d36-8bd29c9d20b1 for instance with vm_state active and task_state reboot_started.
Nov 27 05:10:55 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Instance shutdown successfully.
Nov 27 05:10:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-d162929b-8fd9-49f3-87e4-36ce765303bc req-58463f0c-1297-4e8e-92c8-177c0f10a971 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d162929b-8fd9-49f3-87e4-36ce765303bc req-58463f0c-1297-4e8e-92c8-177c0f10a971 service nova] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d162929b-8fd9-49f3-87e4-36ce765303bc req-58463f0c-1297-4e8e-92c8-177c0f10a971 service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d162929b-8fd9-49f3-87e4-36ce765303bc req-58463f0c-1297-4e8e-92c8-177c0f10a971 service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-d162929b-8fd9-49f3-87e4-36ce765303bc req-58463f0c-1297-4e8e-92c8-177c0f10a971 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] No waiting events found dispatching network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:10:57 user nova-compute[75260]: WARNING nova.compute.manager [req-d162929b-8fd9-49f3-87e4-36ce765303bc req-58463f0c-1297-4e8e-92c8-177c0f10a971 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received unexpected event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 for instance with vm_state active and task_state reboot_started.
Nov 27 05:10:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:10:59 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Instance running successfully.
Nov 27 05:10:59 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Instance soft rebooted successfully.
Nov 27 05:10:59 user nova-compute[75260]: DEBUG nova.compute.manager [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:10:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] No waiting events found dispatching network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:10:59 user nova-compute[75260]: WARNING nova.compute.manager [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received unexpected event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 for instance with vm_state active and task_state reboot_started.
Nov 27 05:10:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:10:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:10:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:10:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] No waiting events found dispatching network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:10:59 user nova-compute[75260]: WARNING nova.compute.manager [req-bd520d65-f56e-46e5-ae25-5422c901b450 req-4caaa544-0e6c-4739-92a4-0ee09c4934ce service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received unexpected event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 for instance with vm_state active and task_state reboot_started.
Nov 27 05:10:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-77338522-0bdb-4805-b9b2-121a2bcf0b23 tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.123s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:10:59 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:11:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:11:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:11:05 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:11:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:07 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:11:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:11:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 05:11:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:11:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:11:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:11:07 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid c0f2d0d5-6181-4702-b582-0ab94adc8fc3 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:11:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updating instance_info_cache with network_info: [{"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:11:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-c0f2d0d5-6181-4702-b582-0ab94adc8fc3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:11:08 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:11:08 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:11:08 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:11:08 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:11:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:11 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:11:11 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:11:11 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:11:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:11:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:11:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:11:11 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:11:12 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:11:13 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:11:13 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:11:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8388MB free_disk=25.146141052246094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance c0f2d0d5-6181-4702-b582-0ab94adc8fc3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 856b6b6c-c631-4d92-80f9-ae659a1c966b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance c310bdfe-2573-46b1-8a2e-f39ad9c1f55c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d7e4e399-4234-498c-b87a-9ed75477e2b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:11:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:11:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:11:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:11:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:11:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:11:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-ff51f945-e701-49f7-b83a-224a3b43d96b req-24e542de-55ef-4b74-8c8d-c0edbbf3213f service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received event network-changed-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG nova.compute.manager [req-ff51f945-e701-49f7-b83a-224a3b43d96b req-24e542de-55ef-4b74-8c8d-c0edbbf3213f service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Refreshing instance network info cache due to event network-changed-9782db4a-8431-44dc-ad9b-d0a581b86b44. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ff51f945-e701-49f7-b83a-224a3b43d96b req-24e542de-55ef-4b74-8c8d-c0edbbf3213f service nova] Acquiring lock "refresh_cache-c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ff51f945-e701-49f7-b83a-224a3b43d96b req-24e542de-55ef-4b74-8c8d-c0edbbf3213f service nova] Acquired lock "refresh_cache-c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:11:56 user nova-compute[75260]: DEBUG nova.network.neutron [req-ff51f945-e701-49f7-b83a-224a3b43d96b req-24e542de-55ef-4b74-8c8d-c0edbbf3213f service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Refreshing network info cache for port 9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-ff51f945-e701-49f7-b83a-224a3b43d96b req-24e542de-55ef-4b74-8c8d-c0edbbf3213f service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Updated VIF entry in instance network info cache for port 9782db4a-8431-44dc-ad9b-d0a581b86b44. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG nova.network.neutron [req-ff51f945-e701-49f7-b83a-224a3b43d96b req-24e542de-55ef-4b74-8c8d-c0edbbf3213f service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Updating instance_info_cache with network_info: [{"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ff51f945-e701-49f7-b83a-224a3b43d96b req-24e542de-55ef-4b74-8c8d-c0edbbf3213f service nova] Releasing lock "refresh_cache-c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:11:57 user nova-compute[75260]: INFO nova.compute.manager [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Terminating instance
Nov 27 05:11:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-7d6ab52b-a6da-44fd-a7a8-8ba1c08105a3 req-d727c371-c20b-4431-ac60-95e2201e458c service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received event network-vif-unplugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7d6ab52b-a6da-44fd-a7a8-8ba1c08105a3 req-d727c371-c20b-4431-ac60-95e2201e458c service nova] Acquiring lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7d6ab52b-a6da-44fd-a7a8-8ba1c08105a3 req-d727c371-c20b-4431-ac60-95e2201e458c service nova] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7d6ab52b-a6da-44fd-a7a8-8ba1c08105a3 req-d727c371-c20b-4431-ac60-95e2201e458c service nova] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-7d6ab52b-a6da-44fd-a7a8-8ba1c08105a3 req-d727c371-c20b-4431-ac60-95e2201e458c service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] No waiting events found dispatching network-vif-unplugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG nova.compute.manager [req-7d6ab52b-a6da-44fd-a7a8-8ba1c08105a3 req-d727c371-c20b-4431-ac60-95e2201e458c service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received event network-vif-unplugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Instance destroyed successfully.
Nov 27 05:11:58 user nova-compute[75260]: DEBUG nova.objects.instance [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'resources' on Instance uuid c310bdfe-2573-46b1-8a2e-f39ad9c1f55c {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1867659401',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1867659401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1867659401',id=48,image_ref='e02ff776-34e3-4810-b4bf-5021b3f21df6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhf4P+4AgTIjOPjFb1PFoApXwVhG59Ih5hxl52c/8xEnL/U829dHLW4nHLPl0kNzgSSe9TeEd/GvwkwKuq3f8PehxdKtXqHizIId1KLwIzm7fQH8pqvNVLjV5Hegpa3Mg==',key_name='tempest-keypair-1745859104',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:10:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-5v9zfjz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1806325901',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=c310bdfe-2573-46b1-8a2e-f39ad9c1f55c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "address": "fa:16:3e:e1:6b:68", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9782db4a-84", "ovs_interfaceid": "9782db4a-8431-44dc-ad9b-d0a581b86b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:6b:68,bridge_name='br-int',has_traffic_filtering=True,id=9782db4a-8431-44dc-ad9b-d0a581b86b44,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9782db4a-84') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_vif [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:6b:68,bridge_name='br-int',has_traffic_filtering=True,id=9782db4a-8431-44dc-ad9b-d0a581b86b44,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9782db4a-84') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9782db4a-84, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f159edf3-9f43-4b02-8235-8504fafa71db) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:11:58 user nova-compute[75260]: INFO os_vif [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:6b:68,bridge_name='br-int',has_traffic_filtering=True,id=9782db4a-8431-44dc-ad9b-d0a581b86b44,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9782db4a-84')
Nov 27 05:11:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMfpWLqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:11:58 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f8a353-d964-45c4-a0ef-b3ffb72d747b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:11:58 user nova-compute[75260]: No targets found.
Nov 27 05:11:58 user nova-compute[75260]: iSNS:
Nov 27 05:11:58 user nova-compute[75260]: No targets found.
Nov 27 05:11:58 user nova-compute[75260]: STATIC:
Nov 27 05:11:58 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f
Nov 27 05:11:58 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:11:58 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:11:58 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3
Nov 27 05:11:58 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:11:58 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:11:58 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec
Nov 27 05:11:58 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:11:58 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:11:58 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c
Nov 27 05:11:58 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:11:58 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:11:58 user nova-compute[75260]: FIRMWARE:
Nov 27 05:11:58 user nova-compute[75260]: No targets found.
Nov 27 05:11:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:11:58 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:11:58 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2f8996-6ba8-4308-94fc-ce13da8c8b36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1c995b-a851-4ed3-8097-fabc438ba36f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:11:58 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:11:58 user nova-compute[75260]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)
Nov 27 05:11:58 user nova-compute[75260]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)
Nov 27 05:11:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:11:58 user nova-compute[75260]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c (non-flash)
Nov 27 05:11:58 user nova-compute[75260]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)
Nov 27 05:11:58 user nova-compute[75260]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)
Nov 27 05:11:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb544a23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6e2194-a583-40b7-a69d-9bcd82dfb2b2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1d65f7-4a09-487d-8b5d-b8642b530ebe]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a4da3-197d-4137-a266-e552c51e7041]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5940af6e-ae68-4495-8013-99ec62172ba1]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56e28da-be63-43c3-87ef-43a3e92fdab6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[33015bb5-447b-4a45-a1de-fdd5026dc473]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c, portal: 172.16.0.220,3260]
Nov 27 05:11:58 user nova-compute[75260]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c, portal: 172.16.0.220,3260] successful.
Nov 27 05:11:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba63eb27-1564-4855-82ba-02b65479c70c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cfd432-f486-4277-bce1-05ec0dae65a0]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== disconnect_volume: return (324ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:11:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Deleting instance files /opt/stack/data/nova/instances/c310bdfe-2573-46b1-8a2e-f39ad9c1f55c_del
Nov 27 05:11:58 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Deletion of /opt/stack/data/nova/instances/c310bdfe-2573-46b1-8a2e-f39ad9c1f55c_del complete
Nov 27 05:11:58 user nova-compute[75260]: INFO nova.compute.manager [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 27 05:11:58 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:11:58 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:11:59 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:11:59 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Took 0.78 seconds to deallocate network for instance.
Nov 27 05:11:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-a6a28757-722a-400b-82a0-37b004623119 req-34934173-2114-4131-ac07-6dc2849f41e6 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received event network-vif-deleted-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:11:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-b0e0e0a5-cfc7-42b2-9a98-c7b0bbc1c859 req-0042fe5d-14c1-499c-8227-df1f72e73d31 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received event network-vif-plugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:11:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b0e0e0a5-cfc7-42b2-9a98-c7b0bbc1c859 req-0042fe5d-14c1-499c-8227-df1f72e73d31 service nova] Acquiring lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:11:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b0e0e0a5-cfc7-42b2-9a98-c7b0bbc1c859 req-0042fe5d-14c1-499c-8227-df1f72e73d31 service nova] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:11:59 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b0e0e0a5-cfc7-42b2-9a98-c7b0bbc1c859 req-0042fe5d-14c1-499c-8227-df1f72e73d31 service nova] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:11:59 user nova-compute[75260]: DEBUG nova.compute.manager [req-b0e0e0a5-cfc7-42b2-9a98-c7b0bbc1c859 req-0042fe5d-14c1-499c-8227-df1f72e73d31 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] No waiting events found dispatching network-vif-plugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:11:59 user nova-compute[75260]: WARNING nova.compute.manager [req-b0e0e0a5-cfc7-42b2-9a98-c7b0bbc1c859 req-0042fe5d-14c1-499c-8227-df1f72e73d31 service nova] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Received unexpected event network-vif-plugged-9782db4a-8431-44dc-ad9b-d0a581b86b44 for instance with vm_state active and task_state deleting.
Nov 27 05:12:00 user nova-compute[75260]: INFO nova.compute.manager [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Took 0.80 seconds to detach 1 volumes for instance.
Nov 27 05:12:00 user nova-compute[75260]: DEBUG nova.compute.manager [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c310bdfe-2573-46b1-8a2e-f39ad9c1f55c] Deleting volume: ba63eb27-1564-4855-82ba-02b65479c70c {{(pid=75260) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 05:12:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:00 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:12:00 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:12:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:00 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Deleted allocations for instance c310bdfe-2573-46b1-8a2e-f39ad9c1f55c
Nov 27 05:12:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-a2713b4b-a2b7-4f58-8155-2e851f64778e tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c310bdfe-2573-46b1-8a2e-f39ad9c1f55c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.240s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:12:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:01 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:01 user nova-compute[75260]: INFO nova.compute.manager [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Detaching volume da85b7e1-2451-493a-93b8-d70d6a8cf31f
Nov 27 05:12:02 user nova-compute[75260]: INFO nova.virt.block_device [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Attempting to driver detach volume da85b7e1-2451-493a-93b8-d70d6a8cf31f from mountpoint /dev/vdc
Nov 27 05:12:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Attempting to detach device vdc from instance d7e4e399-4234-498c-b87a-9ed75477e2b6 from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 05:12:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:12:02 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:12:02 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:12:02 user nova-compute[75260]:   <target dev="vdc" bus="virtio"/>
Nov 27 05:12:02 user nova-compute[75260]:   <serial>da85b7e1-2451-493a-93b8-d70d6a8cf31f</serial>
Nov 27 05:12:02 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 05:12:02 user nova-compute[75260]: </disk>
Nov 27 05:12:02 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:12:02 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Successfully detached device vdc from instance d7e4e399-4234-498c-b87a-9ed75477e2b6 from the persistent domain config.
Nov 27 05:12:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d7e4e399-4234-498c-b87a-9ed75477e2b6 from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 05:12:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:12:02 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:12:02 user nova-compute[75260]:   <source dev="/dev/sdd"/>
Nov 27 05:12:02 user nova-compute[75260]:   <target dev="vdc" bus="virtio"/>
Nov 27 05:12:02 user nova-compute[75260]:   <serial>da85b7e1-2451-493a-93b8-d70d6a8cf31f</serial>
Nov 27 05:12:02 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 05:12:02 user nova-compute[75260]: </disk>
Nov 27 05:12:02 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:12:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 05:12:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:12:05 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:12:05 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:12:07 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:12:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:12:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:12:07 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:12:07 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:12:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating instance_info_cache with network_info: [{"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:12:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:12:08 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:12:08 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:12:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:12:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:12:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:12:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:12:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:12:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:12:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:12:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:12:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:12:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:12:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:12:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:12:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:12:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:12:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=25.14498519897461GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance c0f2d0d5-6181-4702-b582-0ab94adc8fc3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 856b6b6c-c631-4d92-80f9-ae659a1c966b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d7e4e399-4234-498c-b87a-9ed75477e2b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:12:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:22 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d7e4e399-4234-498c-b87a-9ed75477e2b6 is timed out.
Nov 27 05:12:22 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Successfully detached device vdc from instance d7e4e399-4234-498c-b87a-9ed75477e2b6 from the live domain config.
Nov 27 05:12:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cEHqwYbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:12:22 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6223a42-b34c-4491-a4b5-be24c6c60a8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:12:22 user nova-compute[75260]: No targets found.
Nov 27 05:12:22 user nova-compute[75260]: iSNS:
Nov 27 05:12:22 user nova-compute[75260]: No targets found.
Nov 27 05:12:22 user nova-compute[75260]: STATIC:
Nov 27 05:12:22 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f
Nov 27 05:12:22 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:12:22 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:12:22 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3
Nov 27 05:12:22 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:12:22 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:12:22 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec
Nov 27 05:12:22 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:12:22 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:12:22 user nova-compute[75260]: FIRMWARE:
Nov 27 05:12:22 user nova-compute[75260]: No targets found.
Nov 27 05:12:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:12:22 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:12:22 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[766c4e40-c0ae-4111-95cb-516f580122da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdb1962-147e-49fb-bf96-2575d97a7aa5]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:12:22 user nova-compute[75260]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)
Nov 27 05:12:22 user nova-compute[75260]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)
Nov 27 05:12:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:12:22 user nova-compute[75260]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f (non-flash)
Nov 27 05:12:22 user nova-compute[75260]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)
Nov 27 05:12:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb544a0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f'): ({'sdd'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Removing single pathed devices sdd {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a81eae-3dc0-42a2-86bf-aa860c4d82c3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8634bd6f-0001-4a8f-9ac4-b34a587a2b16]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Flushing IO for device /dev/sdd {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5a4f80-6aa0-4d67-821c-eac92dcfb1c9]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb993d4-32ca-4184-97c5-bcc840ccaf6c]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] SCSI volumes sdd have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8c0f85-c6db-4d80-aa50-eef4a1e6bfcd]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e6be4c-154f-4c6b-adff-121be9659ae3]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f, portal: 172.16.0.220,3260]
Nov 27 05:12:22 user nova-compute[75260]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f, portal: 172.16.0.220,3260] successful.
Nov 27 05:12:22 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da85b7e1-2451-493a-93b8-d70d6a8cf31f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[55193102-54ee-4417-8a12-d2cac6edf6c5]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] <== disconnect_volume: return (299ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:12:22 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:12:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:12:23 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'flavor' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:12:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e2a2393a-d093-4b3a-abda-3d38d0402b4b tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:12:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:12:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:12:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:12:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-b268f019-7791-498e-adda-7ae35ebb0f7f req-66de9478-61c0-4522-a587-7f8dcd6f865d service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-changed-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-b268f019-7791-498e-adda-7ae35ebb0f7f req-66de9478-61c0-4522-a587-7f8dcd6f865d service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Refreshing instance network info cache due to event network-changed-69453649-30eb-4496-8d36-8bd29c9d20b1. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b268f019-7791-498e-adda-7ae35ebb0f7f req-66de9478-61c0-4522-a587-7f8dcd6f865d service nova] Acquiring lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b268f019-7791-498e-adda-7ae35ebb0f7f req-66de9478-61c0-4522-a587-7f8dcd6f865d service nova] Acquired lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:12:43 user nova-compute[75260]: DEBUG nova.network.neutron [req-b268f019-7791-498e-adda-7ae35ebb0f7f req-66de9478-61c0-4522-a587-7f8dcd6f865d service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Refreshing network info cache for port 69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-b268f019-7791-498e-adda-7ae35ebb0f7f req-66de9478-61c0-4522-a587-7f8dcd6f865d service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updated VIF entry in instance network info cache for port 69453649-30eb-4496-8d36-8bd29c9d20b1. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-b268f019-7791-498e-adda-7ae35ebb0f7f req-66de9478-61c0-4522-a587-7f8dcd6f865d service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating instance_info_cache with network_info: [{"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b268f019-7791-498e-adda-7ae35ebb0f7f req-66de9478-61c0-4522-a587-7f8dcd6f865d service nova] Releasing lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-5db58bd8-5ce8-48a9-8102-0f410305f6be req-94cd1a9f-fd68-4416-bdaf-eec26a32bca8 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-changed-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-5db58bd8-5ce8-48a9-8102-0f410305f6be req-94cd1a9f-fd68-4416-bdaf-eec26a32bca8 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Refreshing instance network info cache due to event network-changed-69453649-30eb-4496-8d36-8bd29c9d20b1. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5db58bd8-5ce8-48a9-8102-0f410305f6be req-94cd1a9f-fd68-4416-bdaf-eec26a32bca8 service nova] Acquiring lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5db58bd8-5ce8-48a9-8102-0f410305f6be req-94cd1a9f-fd68-4416-bdaf-eec26a32bca8 service nova] Acquired lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG nova.network.neutron [req-5db58bd8-5ce8-48a9-8102-0f410305f6be req-94cd1a9f-fd68-4416-bdaf-eec26a32bca8 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Refreshing network info cache for port 69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:44 user nova-compute[75260]: INFO nova.compute.manager [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Detaching volume f5ded4ef-7725-4a7c-8759-a521ffeae4ec
Nov 27 05:12:44 user nova-compute[75260]: INFO nova.virt.block_device [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Attempting to driver detach volume f5ded4ef-7725-4a7c-8759-a521ffeae4ec from mountpoint /dev/vdb
Nov 27 05:12:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Attempting to detach device vdb from instance 856b6b6c-c631-4d92-80f9-ae659a1c966b from the persistent domain config. {{(pid=75260) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:12:44 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:12:44 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 05:12:44 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:12:44 user nova-compute[75260]:   <serial>f5ded4ef-7725-4a7c-8759-a521ffeae4ec</serial>
Nov 27 05:12:44 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 05:12:44 user nova-compute[75260]: </disk>
Nov 27 05:12:44 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:12:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Successfully detached device vdb from instance 856b6b6c-c631-4d92-80f9-ae659a1c966b from the persistent domain config.
Nov 27 05:12:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 856b6b6c-c631-4d92-80f9-ae659a1c966b from the live domain config. {{(pid=75260) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 05:12:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.guest [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 05:12:44 user nova-compute[75260]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:12:44 user nova-compute[75260]:   <source dev="/dev/sde"/>
Nov 27 05:12:44 user nova-compute[75260]:   <target dev="vdb" bus="virtio"/>
Nov 27 05:12:44 user nova-compute[75260]:   <serial>f5ded4ef-7725-4a7c-8759-a521ffeae4ec</serial>
Nov 27 05:12:44 user nova-compute[75260]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 05:12:44 user nova-compute[75260]: </disk>
Nov 27 05:12:44 user nova-compute[75260]:  {{(pid=75260) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 05:12:45 user nova-compute[75260]: DEBUG nova.network.neutron [req-5db58bd8-5ce8-48a9-8102-0f410305f6be req-94cd1a9f-fd68-4416-bdaf-eec26a32bca8 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updated VIF entry in instance network info cache for port 69453649-30eb-4496-8d36-8bd29c9d20b1. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:12:45 user nova-compute[75260]: DEBUG nova.network.neutron [req-5db58bd8-5ce8-48a9-8102-0f410305f6be req-94cd1a9f-fd68-4416-bdaf-eec26a32bca8 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating instance_info_cache with network_info: [{"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:12:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5db58bd8-5ce8-48a9-8102-0f410305f6be req-94cd1a9f-fd68-4416-bdaf-eec26a32bca8 service nova] Releasing lock "refresh_cache-856b6b6c-c631-4d92-80f9-ae659a1c966b" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:12:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 856b6b6c-c631-4d92-80f9-ae659a1c966b {{(pid=75260) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 05:12:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:51 user nova-compute[75260]: INFO nova.compute.manager [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Terminating instance
Nov 27 05:12:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-6265e598-7e75-4f39-96cf-b5e8ab1c3cd4 req-10728804-f7ac-4c56-a131-4789da96d6f0 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received event network-vif-unplugged-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6265e598-7e75-4f39-96cf-b5e8ab1c3cd4 req-10728804-f7ac-4c56-a131-4789da96d6f0 service nova] Acquiring lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6265e598-7e75-4f39-96cf-b5e8ab1c3cd4 req-10728804-f7ac-4c56-a131-4789da96d6f0 service nova] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6265e598-7e75-4f39-96cf-b5e8ab1c3cd4 req-10728804-f7ac-4c56-a131-4789da96d6f0 service nova] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-6265e598-7e75-4f39-96cf-b5e8ab1c3cd4 req-10728804-f7ac-4c56-a131-4789da96d6f0 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] No waiting events found dispatching network-vif-unplugged-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-6265e598-7e75-4f39-96cf-b5e8ab1c3cd4 req-10728804-f7ac-4c56-a131-4789da96d6f0 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received event network-vif-unplugged-65596b71-101a-4ee5-82e8-45ea7fd38708 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:12:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Instance destroyed successfully.
Nov 27 05:12:51 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'resources' on Instance uuid c0f2d0d5-6181-4702-b582-0ab94adc8fc3 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1265124460',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1265124460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1265124460',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3Kml+UxtFy/tZij1yctuEcq5/61b7J29BVUMb+9A/hOEWyk+Et6KbP0Pjhojv30ttuURNSg/90d95QOKlkSGeG2SZQ/XJ5iIIgxDZXdecmeS7SiebC05D2dEDH5rN/vA==',key_name='tempest-keypair-456010302',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-v96r06cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:08:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=c0f2d0d5-6181-4702-b582-0ab94adc8fc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "65596b71-101a-4ee5-82e8-45ea7fd38708", "address": "fa:16:3e:30:2e:c2", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65596b71-10", "ovs_interfaceid": "65596b71-101a-4ee5-82e8-45ea7fd38708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:2e:c2,bridge_name='br-int',has_traffic_filtering=True,id=65596b71-101a-4ee5-82e8-45ea7fd38708,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65596b71-10') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG os_vif [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:2e:c2,bridge_name='br-int',has_traffic_filtering=True,id=65596b71-101a-4ee5-82e8-45ea7fd38708,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65596b71-10') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65596b71-10, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3cd248f-8758-48e8-bdf6-cece0d2e55c0) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:51 user nova-compute[75260]: INFO os_vif [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:2e:c2,bridge_name='br-int',has_traffic_filtering=True,id=65596b71-101a-4ee5-82e8-45ea7fd38708,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65596b71-10')
Nov 27 05:12:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjqPyAZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:12:51 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:12:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a8006-381c-4338-9133-0ef368feab86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:12:52 user nova-compute[75260]: No targets found.
Nov 27 05:12:52 user nova-compute[75260]: iSNS:
Nov 27 05:12:52 user nova-compute[75260]: No targets found.
Nov 27 05:12:52 user nova-compute[75260]: STATIC:
Nov 27 05:12:52 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3
Nov 27 05:12:52 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:12:52 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:12:52 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec
Nov 27 05:12:52 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:12:52 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:12:52 user nova-compute[75260]: FIRMWARE:
Nov 27 05:12:52 user nova-compute[75260]: No targets found.
Nov 27 05:12:52 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:12:52 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:12:52 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc321de-4bb3-45a8-a924-8e6ad8917b46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[932f139c-aad3-4bcb-a54d-bce3f0ebd238]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:12:52 user nova-compute[75260]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)
Nov 27 05:12:52 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 (non-flash)
Nov 27 05:12:52 user nova-compute[75260]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)
Nov 27 05:12:52 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb542557e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab6f415-fa2c-49a7-a058-098f824a38f1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[077b068e-ba71-4f0f-883a-7048d4139d74]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eb8e0c-e29c-45c9-b72a-9c53d34448ff]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a2382f-0b1d-4a35-8cb1-201b3219dff3]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[403d414b-3bc5-4944-994e-6659d6aa9baf]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcce387-b64a-4630-a20a-60089ea982b7]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3, portal: 172.16.0.220,3260]
Nov 27 05:12:52 user nova-compute[75260]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3, portal: 172.16.0.220,3260] successful.
Nov 27 05:12:52 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:12:52 user nova-compute[75260]: INFO nova.compute.manager [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Terminating instance
Nov 27 05:12:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976ffee5-7156-429d-bd5d-1b19d6eb94c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f50f7a-9718-46cd-ba97-ea57a818621e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== disconnect_volume: return (322ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:12:52 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Deleting instance files /opt/stack/data/nova/instances/c0f2d0d5-6181-4702-b582-0ab94adc8fc3_del
Nov 27 05:12:52 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Deletion of /opt/stack/data/nova/instances/c0f2d0d5-6181-4702-b582-0ab94adc8fc3_del complete
Nov 27 05:12:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:52 user nova-compute[75260]: INFO nova.compute.manager [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-9de10204-f2c0-4a67-b8a8-20f5ea2cf9c9 req-7a44b494-3123-483b-8884-293aaa2648e8 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-vif-unplugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9de10204-f2c0-4a67-b8a8-20f5ea2cf9c9 req-7a44b494-3123-483b-8884-293aaa2648e8 service nova] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9de10204-f2c0-4a67-b8a8-20f5ea2cf9c9 req-7a44b494-3123-483b-8884-293aaa2648e8 service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9de10204-f2c0-4a67-b8a8-20f5ea2cf9c9 req-7a44b494-3123-483b-8884-293aaa2648e8 service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-9de10204-f2c0-4a67-b8a8-20f5ea2cf9c9 req-7a44b494-3123-483b-8884-293aaa2648e8 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] No waiting events found dispatching network-vif-unplugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:12:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-9de10204-f2c0-4a67-b8a8-20f5ea2cf9c9 req-7a44b494-3123-483b-8884-293aaa2648e8 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-vif-unplugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:12:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Instance destroyed successfully.
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.objects.instance [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'resources' on Instance uuid d7e4e399-4234-498c-b87a-9ed75477e2b6 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T05:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-662644095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-662644095',id=45,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwTee5WzLqQhoRMA4sbX1fAotCAjpFJipUMi3g9gAfLEVR90Y0EtLbqHarpPBhAGLKQlbarxTVB1rw4RYU74yALs0GrJT/AUIoZcxScITh7PRun10sRS4g4yvN5SVkh0A==',key_name='tempest-keypair-730565496',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:10:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-5ynjblwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=d7e4e399-4234-498c-b87a-9ed75477e2b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "address": "fa:16:3e:30:3a:73", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a757f70-bf", "ovs_interfaceid": "3a757f70-bf6a-4b7b-b62c-adc9c158836f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG os_vif [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a757f70-bf, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=349908e0-5a5e-4fb5-9aaa-f434c551ddc0) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:12:53 user nova-compute[75260]: INFO os_vif [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:73,bridge_name='br-int',has_traffic_filtering=True,id=3a757f70-bf6a-4b7b-b62c-adc9c158836f,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a757f70-bf')
Nov 27 05:12:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Deleting instance files /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6_del
Nov 27 05:12:53 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Deletion of /opt/stack/data/nova/instances/d7e4e399-4234-498c-b87a-9ed75477e2b6_del complete
Nov 27 05:12:53 user nova-compute[75260]: INFO nova.compute.manager [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 27 05:12:53 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:12:53 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Took 0.79 seconds to deallocate network for instance.
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-7d0c56b4-3711-40ae-aa8c-897759a8d16c req-b07870ac-1ea1-42fa-894a-4a5050c7bdc1 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received event network-vif-plugged-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7d0c56b4-3711-40ae-aa8c-897759a8d16c req-b07870ac-1ea1-42fa-894a-4a5050c7bdc1 service nova] Acquiring lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7d0c56b4-3711-40ae-aa8c-897759a8d16c req-b07870ac-1ea1-42fa-894a-4a5050c7bdc1 service nova] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7d0c56b4-3711-40ae-aa8c-897759a8d16c req-b07870ac-1ea1-42fa-894a-4a5050c7bdc1 service nova] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-7d0c56b4-3711-40ae-aa8c-897759a8d16c req-b07870ac-1ea1-42fa-894a-4a5050c7bdc1 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] No waiting events found dispatching network-vif-plugged-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:12:53 user nova-compute[75260]: WARNING nova.compute.manager [req-7d0c56b4-3711-40ae-aa8c-897759a8d16c req-b07870ac-1ea1-42fa-894a-4a5050c7bdc1 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received unexpected event network-vif-plugged-65596b71-101a-4ee5-82e8-45ea7fd38708 for instance with vm_state active and task_state deleting.
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.compute.manager [req-7d0c56b4-3711-40ae-aa8c-897759a8d16c req-b07870ac-1ea1-42fa-894a-4a5050c7bdc1 service nova] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Received event network-vif-deleted-65596b71-101a-4ee5-82e8-45ea7fd38708 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:12:53 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Took 0.69 seconds to deallocate network for instance.
Nov 27 05:12:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:53 user nova-compute[75260]: INFO nova.compute.manager [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Took 0.79 seconds to detach 1 volumes for instance.
Nov 27 05:12:53 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: c0f2d0d5-6181-4702-b582-0ab94adc8fc3] Deleting volume: 976ffee5-7156-429d-bd5d-1b19d6eb94c3 {{(pid=75260) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:54 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Deleted allocations for instance d7e4e399-4234-498c-b87a-9ed75477e2b6
Nov 27 05:12:54 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-ba419869-47cc-4ca7-8345-d92397806837 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.943s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:54 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Deleted allocations for instance c0f2d0d5-6181-4702-b582-0ab94adc8fc3
Nov 27 05:12:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3196ee12-1588-408f-a5de-0e3cac73dfc6 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "c0f2d0d5-6181-4702-b582-0ab94adc8fc3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.165s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-972a3cab-5e43-4396-bd66-6e7d42ea2ed6 req-c68e7b87-5317-4e07-b267-a416ff681e58 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-972a3cab-5e43-4396-bd66-6e7d42ea2ed6 req-c68e7b87-5317-4e07-b267-a416ff681e58 service nova] Acquiring lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-972a3cab-5e43-4396-bd66-6e7d42ea2ed6 req-c68e7b87-5317-4e07-b267-a416ff681e58 service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-972a3cab-5e43-4396-bd66-6e7d42ea2ed6 req-c68e7b87-5317-4e07-b267-a416ff681e58 service nova] Lock "d7e4e399-4234-498c-b87a-9ed75477e2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:12:54 user nova-compute[75260]: DEBUG nova.compute.manager [req-972a3cab-5e43-4396-bd66-6e7d42ea2ed6 req-c68e7b87-5317-4e07-b267-a416ff681e58 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] No waiting events found dispatching network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:12:54 user nova-compute[75260]: WARNING nova.compute.manager [req-972a3cab-5e43-4396-bd66-6e7d42ea2ed6 req-c68e7b87-5317-4e07-b267-a416ff681e58 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received unexpected event network-vif-plugged-3a757f70-bf6a-4b7b-b62c-adc9c158836f for instance with vm_state deleted and task_state None.
Nov 27 05:12:55 user nova-compute[75260]: DEBUG nova.compute.manager [req-8b6b0cba-b2ca-4954-a198-1b3208a2d20d req-4e2cfc07-5cce-4e14-a3d3-c4ae3364a334 service nova] [instance: d7e4e399-4234-498c-b87a-9ed75477e2b6] Received event network-vif-deleted-3a757f70-bf6a-4b7b-b62c-adc9c158836f {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:12:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:13:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:05 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 856b6b6c-c631-4d92-80f9-ae659a1c966b is timed out.
Nov 27 05:13:05 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Successfully detached device vdb from instance 856b6b6c-c631-4d92-80f9-ae659a1c966b from the live domain config.
Nov 27 05:13:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDgdqFJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:13:05 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bb44b5-9b8c-44f5-96b7-26517df29621]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:13:05 user nova-compute[75260]: No targets found.
Nov 27 05:13:05 user nova-compute[75260]: iSNS:
Nov 27 05:13:05 user nova-compute[75260]: No targets found.
Nov 27 05:13:05 user nova-compute[75260]: STATIC:
Nov 27 05:13:05 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec
Nov 27 05:13:05 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:13:05 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:13:05 user nova-compute[75260]: FIRMWARE:
Nov 27 05:13:05 user nova-compute[75260]: No targets found.
Nov 27 05:13:05 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:13:05 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:13:05 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[273634a5-2bdf-4694-a9c6-37e40bc01188]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a744140-577e-422a-94fc-ac3c113afda8]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)
Nov 27 05:13:05 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec (non-flash)
Nov 27 05:13:05 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb54255ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec'): ({'sde'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Removing single pathed devices sde {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a454f9b-d9af-419d-af52-68f111fee390]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec182da-0885-46e8-9615-874080bed415]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Flushing IO for device /dev/sde {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dedc7cc-39a6-4fbc-9d16-ad118de21eb1]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f27684-1f42-4f7e-b745-e85bc54fd923]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] SCSI volumes sde have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15917f1-ce64-4c92-a7d6-69757ac985d2]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1da9a03-bc3f-46a2-a99e-26cfab50989c]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec, portal: 172.16.0.220,3260]
Nov 27 05:13:05 user nova-compute[75260]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec, portal: 172.16.0.220,3260] successful.
Nov 27 05:13:05 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ded4ef-7725-4a7c-8759-a521ffeae4ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[614e8f81-a904-421c-831d-98ebe8116a8a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] <== disconnect_volume: return (303ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:13:05 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:13:06 user nova-compute[75260]: DEBUG nova.objects.instance [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'flavor' on Instance uuid 856b6b6c-c631-4d92-80f9-ae659a1c966b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:13:06 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5e09ff67-88cf-4be5-83e2-7101537b8edb tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.823s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:06 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:13:07 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:13:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:13:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 05:13:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:13:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:13:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:13:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:13:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:13:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:13:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:13:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:14 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:13:14 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:13:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=25.171775817871094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 856b6b6c-c631-4d92-80f9-ae659a1c966b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:13:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:16 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:13:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:38 user nova-compute[75260]: INFO nova.compute.manager [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Terminating instance
Nov 27 05:13:38 user nova-compute[75260]: DEBUG nova.compute.manager [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG nova.compute.manager [req-5b50cbd5-0af2-4257-8b5e-90e7e47ddd7e req-a6efcce0-3525-4287-a7df-f7825903213a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-vif-unplugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5b50cbd5-0af2-4257-8b5e-90e7e47ddd7e req-a6efcce0-3525-4287-a7df-f7825903213a service nova] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5b50cbd5-0af2-4257-8b5e-90e7e47ddd7e req-a6efcce0-3525-4287-a7df-f7825903213a service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5b50cbd5-0af2-4257-8b5e-90e7e47ddd7e req-a6efcce0-3525-4287-a7df-f7825903213a service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG nova.compute.manager [req-5b50cbd5-0af2-4257-8b5e-90e7e47ddd7e req-a6efcce0-3525-4287-a7df-f7825903213a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] No waiting events found dispatching network-vif-unplugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:13:38 user nova-compute[75260]: DEBUG nova.compute.manager [req-5b50cbd5-0af2-4257-8b5e-90e7e47ddd7e req-a6efcce0-3525-4287-a7df-f7825903213a service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-vif-unplugged-69453649-30eb-4496-8d36-8bd29c9d20b1 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:39 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Instance destroyed successfully.
Nov 27 05:13:39 user nova-compute[75260]: DEBUG nova.objects.instance [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lazy-loading 'resources' on Instance uuid 856b6b6c-c631-4d92-80f9-ae659a1c966b {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1023812160',display_name='tempest-TestMinimumBasicScenario-server-1023812160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1023812160',id=47,image_ref='40656e54-9be2-4df7-872a-8574b91ce35f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGcycZCJluOOI1EeFc+ciNXD49LdocCXMPQeIzQVs4Tgxu9qK5/ys7NbV/2rRzXqWbEQcGNR21/1ZdQLC+3axjBnMU0pnhXJMEQtX7rAhw9dfjYZzF7S0S3dvr7xk27+Q==',key_name='tempest-TestMinimumBasicScenario-1484888750',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fc3728cb2564827a26f40cbc0ec6b5f',ramdisk_id='',reservation_id='r-119pb7ky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40656e54-9be2-4df7-872a-8574b91ce35f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-372834875',owner_user_name='tempest-TestMinimumBasicScenario-372834875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:10:59Z,user_data=None,user_id='e509f168517f4fef82ce3d34122fd59d',uuid=856b6b6c-c631-4d92-80f9-ae659a1c966b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converting VIF {"id": "69453649-30eb-4496-8d36-8bd29c9d20b1", "address": "fa:16:3e:85:ba:3b", "network": {"id": "3dadfbc3-e162-43eb-a849-74e56242b4b6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-981481499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fc3728cb2564827a26f40cbc0ec6b5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69453649-30", "ovs_interfaceid": "69453649-30eb-4496-8d36-8bd29c9d20b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:ba:3b,bridge_name='br-int',has_traffic_filtering=True,id=69453649-30eb-4496-8d36-8bd29c9d20b1,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69453649-30') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG os_vif [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:ba:3b,bridge_name='br-int',has_traffic_filtering=True,id=69453649-30eb-4496-8d36-8bd29c9d20b1,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69453649-30') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69453649-30, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=596e8647-9d33-48d4-bcf9-e205a64d22a3) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:13:39 user nova-compute[75260]: INFO os_vif [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:ba:3b,bridge_name='br-int',has_traffic_filtering=True,id=69453649-30eb-4496-8d36-8bd29c9d20b1,network=Network(3dadfbc3-e162-43eb-a849-74e56242b4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69453649-30')
Nov 27 05:13:39 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Deleting instance files /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b_del
Nov 27 05:13:39 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Deletion of /opt/stack/data/nova/instances/856b6b6c-c631-4d92-80f9-ae659a1c966b_del complete
Nov 27 05:13:39 user nova-compute[75260]: INFO nova.compute.manager [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 27 05:13:39 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:13:39 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Took 0.41 seconds to deallocate network for instance.
Nov 27 05:13:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:13:39 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:39 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Deleted allocations for instance 856b6b6c-c631-4d92-80f9-ae659a1c966b
Nov 27 05:13:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-02b25a88-78cb-4299-91ba-e1427b9dd9ab tempest-TestMinimumBasicScenario-372834875 tempest-TestMinimumBasicScenario-372834875-project-member] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.561s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:40 user nova-compute[75260]: DEBUG nova.compute.manager [req-cb1bdb1f-6bec-4e54-9ad0-3d85e95d1073 req-a270e508-7ffa-4eb5-aa97-5af0423be9b4 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:13:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cb1bdb1f-6bec-4e54-9ad0-3d85e95d1073 req-a270e508-7ffa-4eb5-aa97-5af0423be9b4 service nova] Acquiring lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cb1bdb1f-6bec-4e54-9ad0-3d85e95d1073 req-a270e508-7ffa-4eb5-aa97-5af0423be9b4 service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-cb1bdb1f-6bec-4e54-9ad0-3d85e95d1073 req-a270e508-7ffa-4eb5-aa97-5af0423be9b4 service nova] Lock "856b6b6c-c631-4d92-80f9-ae659a1c966b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:40 user nova-compute[75260]: DEBUG nova.compute.manager [req-cb1bdb1f-6bec-4e54-9ad0-3d85e95d1073 req-a270e508-7ffa-4eb5-aa97-5af0423be9b4 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] No waiting events found dispatching network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:13:40 user nova-compute[75260]: WARNING nova.compute.manager [req-cb1bdb1f-6bec-4e54-9ad0-3d85e95d1073 req-a270e508-7ffa-4eb5-aa97-5af0423be9b4 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received unexpected event network-vif-plugged-69453649-30eb-4496-8d36-8bd29c9d20b1 for instance with vm_state deleted and task_state None.
Nov 27 05:13:40 user nova-compute[75260]: DEBUG nova.compute.manager [req-cb1bdb1f-6bec-4e54-9ad0-3d85e95d1073 req-a270e508-7ffa-4eb5-aa97-5af0423be9b4 service nova] [instance: 856b6b6c-c631-4d92-80f9-ae659a1c966b] Received event network-vif-deleted-69453649-30eb-4496-8d36-8bd29c9d20b1 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:13:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:13:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:45 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:13:45 user nova-compute[75260]: INFO nova.compute.claims [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Claim successful on node user
Nov 27 05:13:45 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:13:46 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:13:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG nova.policy [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bfa8522667f4592bc4bfb0712b6b1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ba48818d9d412da1471e0f56125dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG nova.compute.manager [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:13:46 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Creating image(s)
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "/opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "/opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.181s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.205s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86,backing_fmt=raw /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk 1073741824" returned: 0 in 0.063s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "e9f2da9023fef25b51ca7893a009fc51f3632d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG nova.network.neutron [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Successfully created port: a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.172s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk. size=1073741824 {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 05:13:46 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.disk.api [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Cannot resize image /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk to a smaller size. {{(pid=75260) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Ensure instance console log exists: /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Successfully updated port: a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquired lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-6e7fc9de-d4eb-499b-ac0b-7c283056a8fd req-1650be2f-ea3d-4790-9a6f-fb15c7671a2f service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-changed-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-6e7fc9de-d4eb-499b-ac0b-7c283056a8fd req-1650be2f-ea3d-4790-9a6f-fb15c7671a2f service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Refreshing instance network info cache due to event network-changed-a5a5a85b-a565-4da7-b1bd-b310950edafd. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6e7fc9de-d4eb-499b-ac0b-7c283056a8fd req-1650be2f-ea3d-4790-9a6f-fb15c7671a2f service nova] Acquiring lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.network.neutron [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating instance_info_cache with network_info: [{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Releasing lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Instance network_info: |[{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6e7fc9de-d4eb-499b-ac0b-7c283056a8fd req-1650be2f-ea3d-4790-9a6f-fb15c7671a2f service nova] Acquired lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.network.neutron [req-6e7fc9de-d4eb-499b-ac0b-7c283056a8fd req-1650be2f-ea3d-4790-9a6f-fb15c7671a2f service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Refreshing network info cache for port a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Start _get_guest_xml network_info=[{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:13:47 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:13:47 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T04:34:59Z,direct_url=<?>,disk_format='qcow2',id=a58facc7-83af-4098-886e-ccf8b18b0095,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e2eec6901a284b46afc99dbeefbc586f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T04:35:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-470052070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-470052070',id=49,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ElAOVom6TMKzYKJcPtfXG6rzQb1nQgeQGu0a6CHhNkbpKQRYE6OJ+pH7SSU1yBVxWgP22smTKQeApkW2XgvVE6023uIyFrbhnBD2auqrXIZvuqMIg6eL7CxuHMp1CcQ==',key_name='tempest-keypair-422796876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-9q07jitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=ae105a4c-292a-4e8f-8ba3-f8a049f36c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.objects.instance [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'pci_devices' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:13:47 user nova-compute[75260]:   <uuid>ae105a4c-292a-4e8f-8ba3-f8a049f36c18</uuid>
Nov 27 05:13:47 user nova-compute[75260]:   <name>instance-00000031</name>
Nov 27 05:13:47 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:13:47 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:13:47 user nova-compute[75260]:   <metadata>
Nov 27 05:13:47 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:13:47 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:13:47 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-470052070</nova:name>
Nov 27 05:13:47 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:13:47</nova:creationTime>
Nov 27 05:13:47 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:13:47 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:13:47 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:13:47 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:13:47 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:13:47 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:13:47 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:13:47 user nova-compute[75260]:       <nova:owner>
Nov 27 05:13:47 user nova-compute[75260]:         <nova:user uuid="0bfa8522667f4592bc4bfb0712b6b1f7">tempest-AttachVolumeShelveTestJSON-1008190038-project-member</nova:user>
Nov 27 05:13:47 user nova-compute[75260]:         <nova:project uuid="c1ba48818d9d412da1471e0f56125dec">tempest-AttachVolumeShelveTestJSON-1008190038</nova:project>
Nov 27 05:13:47 user nova-compute[75260]:       </nova:owner>
Nov 27 05:13:47 user nova-compute[75260]:       <nova:root type="image" uuid="a58facc7-83af-4098-886e-ccf8b18b0095"/>
Nov 27 05:13:47 user nova-compute[75260]:       <nova:ports>
Nov 27 05:13:47 user nova-compute[75260]:         <nova:port uuid="a5a5a85b-a565-4da7-b1bd-b310950edafd">
Nov 27 05:13:47 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 05:13:47 user nova-compute[75260]:         </nova:port>
Nov 27 05:13:47 user nova-compute[75260]:       </nova:ports>
Nov 27 05:13:47 user nova-compute[75260]:     </nova:instance>
Nov 27 05:13:47 user nova-compute[75260]:   </metadata>
Nov 27 05:13:47 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:13:47 user nova-compute[75260]:     <system>
Nov 27 05:13:47 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:13:47 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:13:47 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:13:47 user nova-compute[75260]:       <entry name="serial">ae105a4c-292a-4e8f-8ba3-f8a049f36c18</entry>
Nov 27 05:13:47 user nova-compute[75260]:       <entry name="uuid">ae105a4c-292a-4e8f-8ba3-f8a049f36c18</entry>
Nov 27 05:13:47 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:13:47 user nova-compute[75260]:     </system>
Nov 27 05:13:47 user nova-compute[75260]:   </sysinfo>
Nov 27 05:13:47 user nova-compute[75260]:   <os>
Nov 27 05:13:47 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:13:47 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:13:47 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:13:47 user nova-compute[75260]:   </os>
Nov 27 05:13:47 user nova-compute[75260]:   <features>
Nov 27 05:13:47 user nova-compute[75260]:     <acpi/>
Nov 27 05:13:47 user nova-compute[75260]:     <apic/>
Nov 27 05:13:47 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:13:47 user nova-compute[75260]:   </features>
Nov 27 05:13:47 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:13:47 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:13:47 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:13:47 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:13:47 user nova-compute[75260]:   </clock>
Nov 27 05:13:47 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:13:47 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:13:47 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:13:47 user nova-compute[75260]:   </cpu>
Nov 27 05:13:47 user nova-compute[75260]:   <devices>
Nov 27 05:13:47 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 05:13:47 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 05:13:47 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk"/>
Nov 27 05:13:47 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:13:47 user nova-compute[75260]:     </disk>
Nov 27 05:13:47 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:13:47 user nova-compute[75260]:       <mac address="fa:16:3e:e1:83:da"/>
Nov 27 05:13:47 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:13:47 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:13:47 user nova-compute[75260]:       <target dev="tapa5a5a85b-a5"/>
Nov 27 05:13:47 user nova-compute[75260]:     </interface>
Nov 27 05:13:47 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:13:47 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/console.log" append="off"/>
Nov 27 05:13:47 user nova-compute[75260]:     </serial>
Nov 27 05:13:47 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:13:47 user nova-compute[75260]:     <video>
Nov 27 05:13:47 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:13:47 user nova-compute[75260]:     </video>
Nov 27 05:13:47 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:13:47 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:13:47 user nova-compute[75260]:     </rng>
Nov 27 05:13:47 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:13:47 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:13:47 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:13:47 user nova-compute[75260]:     </memballoon>
Nov 27 05:13:47 user nova-compute[75260]:   </devices>
Nov 27 05:13:47 user nova-compute[75260]: </domain>
Nov 27 05:13:47 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-470052070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-470052070',id=49,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ElAOVom6TMKzYKJcPtfXG6rzQb1nQgeQGu0a6CHhNkbpKQRYE6OJ+pH7SSU1yBVxWgP22smTKQeApkW2XgvVE6023uIyFrbhnBD2auqrXIZvuqMIg6eL7CxuHMp1CcQ==',key_name='tempest-keypair-422796876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-9q07jitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=ae105a4c-292a-4e8f-8ba3-f8a049f36c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG os_vif [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6f8c5de-d7b1-5145-a606-21bfc8d0c975', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5a5a85b-a5, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5a5a85b-a5, col_values=(('qos', UUID('af573a1c-ffd7-431d-862e-8555168ae822')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5a5a85b-a5, col_values=(('external_ids', {'iface-id': 'a5a5a85b-a565-4da7-b1bd-b310950edafd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:83:da', 'vm-uuid': 'ae105a4c-292a-4e8f-8ba3-f8a049f36c18'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:47 user nova-compute[75260]: INFO os_vif [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5')
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:13:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] No VIF found with MAC fa:16:3e:e1:83:da, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:13:48 user nova-compute[75260]: DEBUG nova.network.neutron [req-6e7fc9de-d4eb-499b-ac0b-7c283056a8fd req-1650be2f-ea3d-4790-9a6f-fb15c7671a2f service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updated VIF entry in instance network info cache for port a5a5a85b-a565-4da7-b1bd-b310950edafd. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:13:48 user nova-compute[75260]: DEBUG nova.network.neutron [req-6e7fc9de-d4eb-499b-ac0b-7c283056a8fd req-1650be2f-ea3d-4790-9a6f-fb15c7671a2f service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating instance_info_cache with network_info: [{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:13:48 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-6e7fc9de-d4eb-499b-ac0b-7c283056a8fd req-1650be2f-ea3d-4790-9a6f-fb15c7671a2f service nova] Releasing lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-d7aadafc-d483-4da9-af31-e21264298f00 req-6e86e1d1-ce36-453c-a134-21c61ec7f2e5 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d7aadafc-d483-4da9-af31-e21264298f00 req-6e86e1d1-ce36-453c-a134-21c61ec7f2e5 service nova] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d7aadafc-d483-4da9-af31-e21264298f00 req-6e86e1d1-ce36-453c-a134-21c61ec7f2e5 service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-d7aadafc-d483-4da9-af31-e21264298f00 req-6e86e1d1-ce36-453c-a134-21c61ec7f2e5 service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG nova.compute.manager [req-d7aadafc-d483-4da9-af31-e21264298f00 req-6e86e1d1-ce36-453c-a134-21c61ec7f2e5 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] No waiting events found dispatching network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:13:49 user nova-compute[75260]: WARNING nova.compute.manager [req-d7aadafc-d483-4da9-af31-e21264298f00 req-6e86e1d1-ce36-453c-a134-21c61ec7f2e5 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received unexpected event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd for instance with vm_state building and task_state spawning.
Nov 27 05:13:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:50 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:13:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:50 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:13:51 user nova-compute[75260]: INFO nova.compute.claims [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Claim successful on node user
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:13:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Instance spawned successfully.
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:13:51 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.policy [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bbd9c9317ac4d34ad23932bb35bcc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b302e83cda4b6bacc8e613016c8189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:13:51 user nova-compute[75260]: INFO nova.virt.block_device [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Booting with volume fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 at /dev/vda
Nov 27 05:13:51 user nova-compute[75260]: INFO nova.compute.manager [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.compute.manager [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG os_brick.utils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3831cea8-acf0-4a63-bff5-1a8d1154cfeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:51 user nova-compute[75260]: INFO nova.compute.manager [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Took 5.74 seconds to build instance.
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9683481c-998a-4075-955c-7838c3a5c5b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-512f9eee-7c49-4b35-adfe-a088c83dd8e7 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.848s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa84f40-6789-4730-8799-3f0ae207db0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6225b1-7771-41a4-a0e9-656a234af259]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:13:51 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a92c0d-a4da-40d6-96df-8a1e2315b697]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG os_brick.utils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Updating existing volume attachment record: 562c6b79-065c-4f9e-965c-ae8a7aebb627 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c1dcca1-da3d-427b-8f66-73f71510a90d req-21bcc7a0-09dd-4382-9fc9-5d50e9be977c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c1dcca1-da3d-427b-8f66-73f71510a90d req-21bcc7a0-09dd-4382-9fc9-5d50e9be977c service nova] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c1dcca1-da3d-427b-8f66-73f71510a90d req-21bcc7a0-09dd-4382-9fc9-5d50e9be977c service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-4c1dcca1-da3d-427b-8f66-73f71510a90d req-21bcc7a0-09dd-4382-9fc9-5d50e9be977c service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.compute.manager [req-4c1dcca1-da3d-427b-8f66-73f71510a90d req-21bcc7a0-09dd-4382-9fc9-5d50e9be977c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] No waiting events found dispatching network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:13:51 user nova-compute[75260]: WARNING nova.compute.manager [req-4c1dcca1-da3d-427b-8f66-73f71510a90d req-21bcc7a0-09dd-4382-9fc9-5d50e9be977c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received unexpected event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd for instance with vm_state active and task_state None.
Nov 27 05:13:51 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Successfully created port: 50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Successfully updated port: 50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquired lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-b101841a-be06-46fc-862b-3008ea34ad41 req-b4eb2fc6-3f1f-4e18-89a0-910b6ed75c51 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received event network-changed-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG nova.compute.manager [req-b101841a-be06-46fc-862b-3008ea34ad41 req-b4eb2fc6-3f1f-4e18-89a0-910b6ed75c51 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Refreshing instance network info cache due to event network-changed-50f0b635-1709-4aa2-b245-31909fd6dcfc. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b101841a-be06-46fc-862b-3008ea34ad41 req-b4eb2fc6-3f1f-4e18-89a0-910b6ed75c51 service nova] Acquiring lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG nova.network.neutron [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Updating instance_info_cache with network_info: [{"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Releasing lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Instance network_info: |[{"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b101841a-be06-46fc-862b-3008ea34ad41 req-b4eb2fc6-3f1f-4e18-89a0-910b6ed75c51 service nova] Acquired lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:13:52 user nova-compute[75260]: DEBUG nova.network.neutron [req-b101841a-be06-46fc-862b-3008ea34ad41 req-b4eb2fc6-3f1f-4e18-89a0-910b6ed75c51 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Refreshing network info cache for port 50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:13:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-b101841a-be06-46fc-862b-3008ea34ad41 req-b4eb2fc6-3f1f-4e18-89a0-910b6ed75c51 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Updated VIF entry in instance network info cache for port 50f0b635-1709-4aa2-b245-31909fd6dcfc. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:13:53 user nova-compute[75260]: DEBUG nova.network.neutron [req-b101841a-be06-46fc-862b-3008ea34ad41 req-b4eb2fc6-3f1f-4e18-89a0-910b6ed75c51 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Updating instance_info_cache with network_info: [{"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:13:53 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b101841a-be06-46fc-862b-3008ea34ad41 req-b4eb2fc6-3f1f-4e18-89a0-910b6ed75c51 service nova] Releasing lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:13:57 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Creating image(s)
Nov 27 05:13:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Ensure instance console log exists: /opt/stack/data/nova/instances/d219b714-0bca-4cc1-ac95-ec6c06564cfa/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:13:57 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Start _get_guest_xml network_info=[{"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '562c6b79-065c-4f9e-965c-ae8a7aebb627', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLjDAogv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd219b714-0bca-4cc1-ac95-ec6c06564cfa', 'attached_at': '', 'detached_at': '', 'volume_id': 'fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 'serial': 'fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:13:58 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:13:58 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLjDAogv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:13:58 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:13:58 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:13:58 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[670a9a3c-25a5-4bf4-a151-d9d5a8553943]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:13:58 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abbd536-de3e-4ed7-b9a9-a7b8cd1a644a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788] added
Nov 27 05:13:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57ca32e-3d7a-4a94-b7cd-0617ffb41e48]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2422f143-c01b-4f51-b67a-3b6d795f5e1b]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLjDAogv {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLjDAogv" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a3150b-60ec-4107-bfc2-5de52dc1ad08]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yLjDAogv'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aee448-543b-4b1e-afe1-a89e4260af0a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[365a5091-d636-4e0a-bb2b-c0e2f077b255]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 05:13:58 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 05:13:58 user nova-compute[75260]:  {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:13:58 user nova-compute[75260]: WARNING os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 05:13:58 user nova-compute[75260]: 
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bc7654-863a-4cdb-9ba5-006098547475]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260]
Nov 27 05:13:58 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260] successful.
Nov 27 05:13:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7494ef8-3a6d-4908-ae66-5ea7659e06ad]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afefcfe-3686-406d-bebe-17882baca99a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:13:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:13:58 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bade182-0b2b-4a20-ae43-569e8eccf12a]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:13:58 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLjDAogv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23162623163616439', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162623163616439', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2031595933',display_name='tempest-TestVolumeBootPattern-server-2031595933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2031595933',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxjZgWBkC0vDIW+qP/oRdSAxQoY7m7bOeoA2c9MMZIbWYe3A6sjz1pgcrW4HTR4ErkM9d3sc/JlyOUNttSfKV4iyZ0ArGo73rhxgqnOA8qA96OB7kCqJ04RO/xhIBEqBg==',key_name='tempest-TestVolumeBootPattern-141657573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-0cnscvcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:13:51Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=d219b714-0bca-4cc1-ac95-ec6c06564cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8b:11,bridge_name='br-int',has_traffic_filtering=True,id=50f0b635-1709-4aa2-b245-31909fd6dcfc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0b635-17') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.objects.instance [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'pci_devices' on Instance uuid d219b714-0bca-4cc1-ac95-ec6c06564cfa {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:13:59 user nova-compute[75260]:   <uuid>d219b714-0bca-4cc1-ac95-ec6c06564cfa</uuid>
Nov 27 05:13:59 user nova-compute[75260]:   <name>instance-00000032</name>
Nov 27 05:13:59 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:13:59 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:13:59 user nova-compute[75260]:   <metadata>
Nov 27 05:13:59 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:13:59 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:13:59 user nova-compute[75260]:       <nova:name>tempest-TestVolumeBootPattern-server-2031595933</nova:name>
Nov 27 05:13:59 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:13:58</nova:creationTime>
Nov 27 05:13:59 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:13:59 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:13:59 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:13:59 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:13:59 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:13:59 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:13:59 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:13:59 user nova-compute[75260]:       <nova:owner>
Nov 27 05:13:59 user nova-compute[75260]:         <nova:user uuid="5bbd9c9317ac4d34ad23932bb35bcc87">tempest-TestVolumeBootPattern-1806325901-project-member</nova:user>
Nov 27 05:13:59 user nova-compute[75260]:         <nova:project uuid="c4b302e83cda4b6bacc8e613016c8189">tempest-TestVolumeBootPattern-1806325901</nova:project>
Nov 27 05:13:59 user nova-compute[75260]:       </nova:owner>
Nov 27 05:13:59 user nova-compute[75260]:       <nova:ports>
Nov 27 05:13:59 user nova-compute[75260]:         <nova:port uuid="50f0b635-1709-4aa2-b245-31909fd6dcfc">
Nov 27 05:13:59 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 05:13:59 user nova-compute[75260]:         </nova:port>
Nov 27 05:13:59 user nova-compute[75260]:       </nova:ports>
Nov 27 05:13:59 user nova-compute[75260]:     </nova:instance>
Nov 27 05:13:59 user nova-compute[75260]:   </metadata>
Nov 27 05:13:59 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:13:59 user nova-compute[75260]:     <system>
Nov 27 05:13:59 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:13:59 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:13:59 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:13:59 user nova-compute[75260]:       <entry name="serial">d219b714-0bca-4cc1-ac95-ec6c06564cfa</entry>
Nov 27 05:13:59 user nova-compute[75260]:       <entry name="uuid">d219b714-0bca-4cc1-ac95-ec6c06564cfa</entry>
Nov 27 05:13:59 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:13:59 user nova-compute[75260]:     </system>
Nov 27 05:13:59 user nova-compute[75260]:   </sysinfo>
Nov 27 05:13:59 user nova-compute[75260]:   <os>
Nov 27 05:13:59 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:13:59 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:13:59 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:13:59 user nova-compute[75260]:   </os>
Nov 27 05:13:59 user nova-compute[75260]:   <features>
Nov 27 05:13:59 user nova-compute[75260]:     <acpi/>
Nov 27 05:13:59 user nova-compute[75260]:     <apic/>
Nov 27 05:13:59 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:13:59 user nova-compute[75260]:   </features>
Nov 27 05:13:59 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:13:59 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:13:59 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:13:59 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:13:59 user nova-compute[75260]:   </clock>
Nov 27 05:13:59 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:13:59 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:13:59 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:13:59 user nova-compute[75260]:   </cpu>
Nov 27 05:13:59 user nova-compute[75260]:   <devices>
Nov 27 05:13:59 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:13:59 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:13:59 user nova-compute[75260]:       <source dev="/dev/sdb"/>
Nov 27 05:13:59 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:13:59 user nova-compute[75260]:       <serial>fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788</serial>
Nov 27 05:13:59 user nova-compute[75260]:     </disk>
Nov 27 05:13:59 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:13:59 user nova-compute[75260]:       <mac address="fa:16:3e:8c:8b:11"/>
Nov 27 05:13:59 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:13:59 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:13:59 user nova-compute[75260]:       <target dev="tap50f0b635-17"/>
Nov 27 05:13:59 user nova-compute[75260]:     </interface>
Nov 27 05:13:59 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:13:59 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/d219b714-0bca-4cc1-ac95-ec6c06564cfa/console.log" append="off"/>
Nov 27 05:13:59 user nova-compute[75260]:     </serial>
Nov 27 05:13:59 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:13:59 user nova-compute[75260]:     <video>
Nov 27 05:13:59 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:13:59 user nova-compute[75260]:     </video>
Nov 27 05:13:59 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:13:59 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:13:59 user nova-compute[75260]:     </rng>
Nov 27 05:13:59 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:13:59 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:13:59 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:13:59 user nova-compute[75260]:     </memballoon>
Nov 27 05:13:59 user nova-compute[75260]:   </devices>
Nov 27 05:13:59 user nova-compute[75260]: </domain>
Nov 27 05:13:59 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2031595933',display_name='tempest-TestVolumeBootPattern-server-2031595933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2031595933',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxjZgWBkC0vDIW+qP/oRdSAxQoY7m7bOeoA2c9MMZIbWYe3A6sjz1pgcrW4HTR4ErkM9d3sc/JlyOUNttSfKV4iyZ0ArGo73rhxgqnOA8qA96OB7kCqJ04RO/xhIBEqBg==',key_name='tempest-TestVolumeBootPattern-141657573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-0cnscvcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:13:51Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=d219b714-0bca-4cc1-ac95-ec6c06564cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8b:11,bridge_name='br-int',has_traffic_filtering=True,id=50f0b635-1709-4aa2-b245-31909fd6dcfc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0b635-17') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG os_vif [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8b:11,bridge_name='br-int',has_traffic_filtering=True,id=50f0b635-1709-4aa2-b245-31909fd6dcfc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0b635-17') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'feedd114-e8ad-553f-ae97-05e818e38b10', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50f0b635-17, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50f0b635-17, col_values=(('qos', UUID('0272c881-9cc4-41dc-93f8-cc1aad8eeb8b')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50f0b635-17, col_values=(('external_ids', {'iface-id': '50f0b635-1709-4aa2-b245-31909fd6dcfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:8b:11', 'vm-uuid': 'd219b714-0bca-4cc1-ac95-ec6c06564cfa'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:13:59 user nova-compute[75260]: INFO os_vif [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:8b:11,bridge_name='br-int',has_traffic_filtering=True,id=50f0b635-1709-4aa2-b245-31909fd6dcfc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0b635-17')
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:13:59 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No VIF found with MAC fa:16:3e:8c:8b:11, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:14:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-166aea7a-26bc-4ddd-82a6-9c244924692f req-dcabeddd-272e-48df-bd0c-1f3c93a034ec service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received event network-vif-plugged-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:14:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-166aea7a-26bc-4ddd-82a6-9c244924692f req-dcabeddd-272e-48df-bd0c-1f3c93a034ec service nova] Acquiring lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:14:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-166aea7a-26bc-4ddd-82a6-9c244924692f req-dcabeddd-272e-48df-bd0c-1f3c93a034ec service nova] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:14:00 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-166aea7a-26bc-4ddd-82a6-9c244924692f req-dcabeddd-272e-48df-bd0c-1f3c93a034ec service nova] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:14:00 user nova-compute[75260]: DEBUG nova.compute.manager [req-166aea7a-26bc-4ddd-82a6-9c244924692f req-dcabeddd-272e-48df-bd0c-1f3c93a034ec service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] No waiting events found dispatching network-vif-plugged-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:14:00 user nova-compute[75260]: WARNING nova.compute.manager [req-166aea7a-26bc-4ddd-82a6-9c244924692f req-dcabeddd-272e-48df-bd0c-1f3c93a034ec service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received unexpected event network-vif-plugged-50f0b635-1709-4aa2-b245-31909fd6dcfc for instance with vm_state building and task_state spawning.
Nov 27 05:14:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:14:02 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Instance spawned successfully.
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:14:02 user nova-compute[75260]: INFO nova.compute.manager [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.compute.manager [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-3ec4ec95-ca17-4234-990e-688b91be489d req-1ea2d23f-8a83-4aab-8d64-80f3372e61cb service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received event network-vif-plugged-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3ec4ec95-ca17-4234-990e-688b91be489d req-1ea2d23f-8a83-4aab-8d64-80f3372e61cb service nova] Acquiring lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3ec4ec95-ca17-4234-990e-688b91be489d req-1ea2d23f-8a83-4aab-8d64-80f3372e61cb service nova] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-3ec4ec95-ca17-4234-990e-688b91be489d req-1ea2d23f-8a83-4aab-8d64-80f3372e61cb service nova] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:14:02 user nova-compute[75260]: DEBUG nova.compute.manager [req-3ec4ec95-ca17-4234-990e-688b91be489d req-1ea2d23f-8a83-4aab-8d64-80f3372e61cb service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] No waiting events found dispatching network-vif-plugged-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:14:02 user nova-compute[75260]: WARNING nova.compute.manager [req-3ec4ec95-ca17-4234-990e-688b91be489d req-1ea2d23f-8a83-4aab-8d64-80f3372e61cb service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received unexpected event network-vif-plugged-50f0b635-1709-4aa2-b245-31909fd6dcfc for instance with vm_state building and task_state spawning.
Nov 27 05:14:03 user nova-compute[75260]: INFO nova.compute.manager [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Took 12.07 seconds to build instance.
Nov 27 05:14:03 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-c64275c2-ddb7-4501-9748-ac5e11267f11 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.165s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:14:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:06 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:14:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:07 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:14:07 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:14:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:14:07 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 05:14:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:14:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:14:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:14:08 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:14:08 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating instance_info_cache with network_info: [{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:14:08 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:14:08 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:14:08 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:14:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:11 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:14:11 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:14:11 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:14:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:14:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:14:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:14:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:14:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:14:13 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:14 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:14:14 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:14:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=25.162105560302734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance ae105a4c-292a-4e8f-8ba3-f8a049f36c18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d219b714-0bca-4cc1-ac95-ec6c06564cfa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:14:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:14:16 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:14:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:22 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Verify base images {{(pid=75260) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75260) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Image id a58facc7-83af-4098-886e-ccf8b18b0095 yields fingerprint e9f2da9023fef25b51ca7893a009fc51f3632d86 {{(pid=75260) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 27 05:14:30 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] image a58facc7-83af-4098-886e-ccf8b18b0095 at (/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86): checking
Nov 27 05:14:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] image a58facc7-83af-4098-886e-ccf8b18b0095 at (/opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86): image is in use {{(pid=75260) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] ae105a4c-292a-4e8f-8ba3-f8a049f36c18 is a valid instance name {{(pid=75260) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] ae105a4c-292a-4e8f-8ba3-f8a049f36c18 has a disk file {{(pid=75260) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 27 05:14:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:14:31 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:14:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance ae105a4c-292a-4e8f-8ba3-f8a049f36c18 is backed by e9f2da9023fef25b51ca7893a009fc51f3632d86 {{(pid=75260) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 27 05:14:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] d219b714-0bca-4cc1-ac95-ec6c06564cfa is a valid instance name {{(pid=75260) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 27 05:14:31 user nova-compute[75260]: WARNING nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59
Nov 27 05:14:31 user nova-compute[75260]: WARNING nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397
Nov 27 05:14:31 user nova-compute[75260]: WARNING nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e
Nov 27 05:14:31 user nova-compute[75260]: WARNING nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e
Nov 27 05:14:31 user nova-compute[75260]: WARNING nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d
Nov 27 05:14:31 user nova-compute[75260]: WARNING nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1
Nov 27 05:14:31 user nova-compute[75260]: WARNING nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec
Nov 27 05:14:31 user nova-compute[75260]: WARNING nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab
Nov 27 05:14:31 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Active base files: /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86
Nov 27 05:14:31 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Removable base files: /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59 /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397 /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1 /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab
Nov 27 05:14:31 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e4f4008ab756d8d1bc2437b654d4d18958b04f59
Nov 27 05:14:31 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b7d56e9b7f9717367efcbd24f716c4219cbbe397
Nov 27 05:14:31 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7cdeb18d1a93b31dd57a363ce7e4b2cde5751d1e
Nov 27 05:14:31 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a60b1b5d3e1822acc1709d5d0424f5ab500b6b6e
Nov 27 05:14:31 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/91d155b6214398affe7a13146195cb822a90017d
Nov 27 05:14:31 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ccbd70b538de228b02b06aa8398c2dd3bb4f9af1
Nov 27 05:14:31 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f0ad97059fa6ccbd2149270bc544a8dd8fd316ec
Nov 27 05:14:31 user nova-compute[75260]: INFO nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1f97dada6faaeed8012122c9627f65db9d644dab
Nov 27 05:14:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Verification complete {{(pid=75260) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 27 05:14:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Verify swap images {{(pid=75260) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 27 05:14:31 user nova-compute[75260]: DEBUG nova.virt.libvirt.imagecache [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Verify ephemeral images {{(pid=75260) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 27 05:14:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:14:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:14:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:14:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:14:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:14:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:14:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:14:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:14:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:14:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:14:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:14:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:01 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:15:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:15:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:15:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:07 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:07 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:07 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:15:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:15:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:15:10 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:15:10 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Updating instance_info_cache with network_info: [{"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:15:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:15:10 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:15:12 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:12 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:15:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:13 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:15:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:14 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:15:14 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:15:14 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:15:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.199398040771484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:15:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance ae105a4c-292a-4e8f-8ba3-f8a049f36c18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance d219b714-0bca-4cc1-ac95-ec6c06564cfa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing inventories for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating ProviderTree inventory for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing aggregate associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, aggregates: None {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing trait associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:15:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:19 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:19 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:22 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:22 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75260) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 05:15:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:15:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:15:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:15:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:33 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:33 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 05:15:33 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] There are 0 instances to clean {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 05:15:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:15:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:15:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:15:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f5f5562-0a1e-4920-b2b2-f39bc7fb5b6e req-97e40243-13f2-4838-8624-fe8278fe5129 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-changed-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:15:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-2f5f5562-0a1e-4920-b2b2-f39bc7fb5b6e req-97e40243-13f2-4838-8624-fe8278fe5129 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Refreshing instance network info cache due to event network-changed-a5a5a85b-a565-4da7-b1bd-b310950edafd. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:15:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f5f5562-0a1e-4920-b2b2-f39bc7fb5b6e req-97e40243-13f2-4838-8624-fe8278fe5129 service nova] Acquiring lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:15:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f5f5562-0a1e-4920-b2b2-f39bc7fb5b6e req-97e40243-13f2-4838-8624-fe8278fe5129 service nova] Acquired lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:15:37 user nova-compute[75260]: DEBUG nova.network.neutron [req-2f5f5562-0a1e-4920-b2b2-f39bc7fb5b6e req-97e40243-13f2-4838-8624-fe8278fe5129 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Refreshing network info cache for port a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:15:37 user nova-compute[75260]: DEBUG nova.network.neutron [req-2f5f5562-0a1e-4920-b2b2-f39bc7fb5b6e req-97e40243-13f2-4838-8624-fe8278fe5129 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updated VIF entry in instance network info cache for port a5a5a85b-a565-4da7-b1bd-b310950edafd. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:15:37 user nova-compute[75260]: DEBUG nova.network.neutron [req-2f5f5562-0a1e-4920-b2b2-f39bc7fb5b6e req-97e40243-13f2-4838-8624-fe8278fe5129 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating instance_info_cache with network_info: [{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:15:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2f5f5562-0a1e-4920-b2b2-f39bc7fb5b6e req-97e40243-13f2-4838-8624-fe8278fe5129 service nova] Releasing lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:15:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:40 user nova-compute[75260]: INFO nova.compute.manager [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Shelving
Nov 27 05:15:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-c6f1f7a4-0236-4262-8886-162ff1549e3d req-b8665bae-90b2-4487-a0fa-f92d32047ed7 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-vif-unplugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c6f1f7a4-0236-4262-8886-162ff1549e3d req-b8665bae-90b2-4487-a0fa-f92d32047ed7 service nova] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c6f1f7a4-0236-4262-8886-162ff1549e3d req-b8665bae-90b2-4487-a0fa-f92d32047ed7 service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c6f1f7a4-0236-4262-8886-162ff1549e3d req-b8665bae-90b2-4487-a0fa-f92d32047ed7 service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG nova.compute.manager [req-c6f1f7a4-0236-4262-8886-162ff1549e3d req-b8665bae-90b2-4487-a0fa-f92d32047ed7 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] No waiting events found dispatching network-vif-unplugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:15:41 user nova-compute[75260]: WARNING nova.compute.manager [req-c6f1f7a4-0236-4262-8886-162ff1549e3d req-b8665bae-90b2-4487-a0fa-f92d32047ed7 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received unexpected event network-vif-unplugged-a5a5a85b-a565-4da7-b1bd-b310950edafd for instance with vm_state active and task_state shelving.
Nov 27 05:15:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:41 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Instance destroyed successfully.
Nov 27 05:15:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:41 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Beginning cold snapshot process
Nov 27 05:15:41 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 05:15:41 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk /opt/stack/data/nova/instances/snapshots/tmp2vzzbgi6/a6fb8d59a65c4c18ac90af1b29e770dd {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk /opt/stack/data/nova/instances/snapshots/tmp2vzzbgi6/a6fb8d59a65c4c18ac90af1b29e770dd" returned: 0 in 0.907s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:42 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Snapshot extracted, beginning image upload
Nov 27 05:15:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-2ea1fef5-1479-4dac-8b96-4f18e95f3a58 req-c7641b00-e149-45d8-b6b5-e3bf1cd63ff7 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2ea1fef5-1479-4dac-8b96-4f18e95f3a58 req-c7641b00-e149-45d8-b6b5-e3bf1cd63ff7 service nova] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2ea1fef5-1479-4dac-8b96-4f18e95f3a58 req-c7641b00-e149-45d8-b6b5-e3bf1cd63ff7 service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2ea1fef5-1479-4dac-8b96-4f18e95f3a58 req-c7641b00-e149-45d8-b6b5-e3bf1cd63ff7 service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-2ea1fef5-1479-4dac-8b96-4f18e95f3a58 req-c7641b00-e149-45d8-b6b5-e3bf1cd63ff7 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] No waiting events found dispatching network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:15:43 user nova-compute[75260]: WARNING nova.compute.manager [req-2ea1fef5-1479-4dac-8b96-4f18e95f3a58 req-c7641b00-e149-45d8-b6b5-e3bf1cd63ff7 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received unexpected event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd for instance with vm_state active and task_state shelving_image_uploading.
Nov 27 05:15:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-1789cdf0-b15a-445e-a61e-123a7f75a6c1 req-190f0192-36bd-4a78-adc1-cc4c249338c6 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received event network-changed-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG nova.compute.manager [req-1789cdf0-b15a-445e-a61e-123a7f75a6c1 req-190f0192-36bd-4a78-adc1-cc4c249338c6 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Refreshing instance network info cache due to event network-changed-50f0b635-1709-4aa2-b245-31909fd6dcfc. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1789cdf0-b15a-445e-a61e-123a7f75a6c1 req-190f0192-36bd-4a78-adc1-cc4c249338c6 service nova] Acquiring lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1789cdf0-b15a-445e-a61e-123a7f75a6c1 req-190f0192-36bd-4a78-adc1-cc4c249338c6 service nova] Acquired lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG nova.network.neutron [req-1789cdf0-b15a-445e-a61e-123a7f75a6c1 req-190f0192-36bd-4a78-adc1-cc4c249338c6 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Refreshing network info cache for port 50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG nova.network.neutron [req-1789cdf0-b15a-445e-a61e-123a7f75a6c1 req-190f0192-36bd-4a78-adc1-cc4c249338c6 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Updated VIF entry in instance network info cache for port 50f0b635-1709-4aa2-b245-31909fd6dcfc. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG nova.network.neutron [req-1789cdf0-b15a-445e-a61e-123a7f75a6c1 req-190f0192-36bd-4a78-adc1-cc4c249338c6 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Updating instance_info_cache with network_info: [{"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1789cdf0-b15a-445e-a61e-123a7f75a6c1 req-190f0192-36bd-4a78-adc1-cc4c249338c6 service nova] Releasing lock "refresh_cache-d219b714-0bca-4cc1-ac95-ec6c06564cfa" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Triggering sync for uuid d219b714-0bca-4cc1-ac95-ec6c06564cfa {{(pid=75260) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:43 user nova-compute[75260]: INFO nova.compute.manager [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Terminating instance
Nov 27 05:15:43 user nova-compute[75260]: DEBUG nova.compute.manager [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-2d24efe7-1593-4606-8de0-983168f28509 req-86014329-0100-4068-a268-405ffdb94888 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received event network-vif-unplugged-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2d24efe7-1593-4606-8de0-983168f28509 req-86014329-0100-4068-a268-405ffdb94888 service nova] Acquiring lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2d24efe7-1593-4606-8de0-983168f28509 req-86014329-0100-4068-a268-405ffdb94888 service nova] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-2d24efe7-1593-4606-8de0-983168f28509 req-86014329-0100-4068-a268-405ffdb94888 service nova] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-2d24efe7-1593-4606-8de0-983168f28509 req-86014329-0100-4068-a268-405ffdb94888 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] No waiting events found dispatching network-vif-unplugged-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-2d24efe7-1593-4606-8de0-983168f28509 req-86014329-0100-4068-a268-405ffdb94888 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received event network-vif-unplugged-50f0b635-1709-4aa2-b245-31909fd6dcfc for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:15:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Instance destroyed successfully.
Nov 27 05:15:44 user nova-compute[75260]: DEBUG nova.objects.instance [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'resources' on Instance uuid d219b714-0bca-4cc1-ac95-ec6c06564cfa {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2031595933',display_name='tempest-TestVolumeBootPattern-server-2031595933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2031595933',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxjZgWBkC0vDIW+qP/oRdSAxQoY7m7bOeoA2c9MMZIbWYe3A6sjz1pgcrW4HTR4ErkM9d3sc/JlyOUNttSfKV4iyZ0ArGo73rhxgqnOA8qA96OB7kCqJ04RO/xhIBEqBg==',key_name='tempest-TestVolumeBootPattern-141657573',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-0cnscvcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:14:03Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=d219b714-0bca-4cc1-ac95-ec6c06564cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "address": "fa:16:3e:8c:8b:11", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0b635-17", "ovs_interfaceid": "50f0b635-1709-4aa2-b245-31909fd6dcfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:8b:11,bridge_name='br-int',has_traffic_filtering=True,id=50f0b635-1709-4aa2-b245-31909fd6dcfc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0b635-17') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_vif [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:8b:11,bridge_name='br-int',has_traffic_filtering=True,id=50f0b635-1709-4aa2-b245-31909fd6dcfc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0b635-17') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50f0b635-17, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0272c881-9cc4-41dc-93f8-cc1aad8eeb8b) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:44 user nova-compute[75260]: INFO os_vif [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:8b:11,bridge_name='br-int',has_traffic_filtering=True,id=50f0b635-1709-4aa2-b245-31909fd6dcfc,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0b635-17')
Nov 27 05:15:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLjDAogv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:15:44 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ab5946-10bc-4374-996b-fd04b7fa7378]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:15:44 user nova-compute[75260]: No targets found.
Nov 27 05:15:44 user nova-compute[75260]: iSNS:
Nov 27 05:15:44 user nova-compute[75260]: No targets found.
Nov 27 05:15:44 user nova-compute[75260]: STATIC:
Nov 27 05:15:44 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788
Nov 27 05:15:44 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:15:44 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:15:44 user nova-compute[75260]: FIRMWARE:
Nov 27 05:15:44 user nova-compute[75260]: No targets found.
Nov 27 05:15:44 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:15:44 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:15:44 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2a7355-41c6-4212-911f-37d507c580a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b31338c-76dc-46d6-9249-2c4e7e2af063]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:15:44 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:15:44 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb541cd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f32e06a-16e0-4a4d-9c7f-ec3ebeb7e962]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8993f05-d722-4210-b9a9-91c7bcad0246]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17f0ac1-931d-4047-b26f-1b30940a455a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c46bf97-48d5-499b-810b-29ee0df1b715]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c58929d-d015-4a3a-8974-eff6212469ef]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:15:44 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c9695f-6ba1-40e6-85ed-4fac9628622e]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260]
Nov 27 05:15:45 user nova-compute[75260]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260] successful.
Nov 27 05:15:45 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[839ec68d-1299-4bd4-a9f4-11e814d19912]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== disconnect_volume: return (313ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:15:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Deleting instance files /opt/stack/data/nova/instances/d219b714-0bca-4cc1-ac95-ec6c06564cfa_del
Nov 27 05:15:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Deletion of /opt/stack/data/nova/instances/d219b714-0bca-4cc1-ac95-ec6c06564cfa_del complete
Nov 27 05:15:45 user nova-compute[75260]: INFO nova.compute.manager [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 27 05:15:45 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:15:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Snapshot image upload complete
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:15:45 user nova-compute[75260]: INFO nova.compute.manager [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Shelve offloading
Nov 27 05:15:45 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Instance destroyed successfully.
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.compute.manager [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquired lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:15:45 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Took 0.74 seconds to deallocate network for instance.
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-0526fc81-ee97-4484-b302-c29967e90509 req-479add4b-23c4-4510-ab17-dc6d6f0e6038 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received event network-vif-deleted-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:15:45 user nova-compute[75260]: INFO nova.compute.manager [req-0526fc81-ee97-4484-b302-c29967e90509 req-479add4b-23c4-4510-ab17-dc6d6f0e6038 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Neutron deleted interface 50f0b635-1709-4aa2-b245-31909fd6dcfc; detaching it from the instance and deleting it from the info cache
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.network.neutron [req-0526fc81-ee97-4484-b302-c29967e90509 req-479add4b-23c4-4510-ab17-dc6d6f0e6038 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-0526fc81-ee97-4484-b302-c29967e90509 req-479add4b-23c4-4510-ab17-dc6d6f0e6038 service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Detach interface failed, port_id=50f0b635-1709-4aa2-b245-31909fd6dcfc, reason: Instance d219b714-0bca-4cc1-ac95-ec6c06564cfa could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 05:15:45 user nova-compute[75260]: DEBUG nova.network.neutron [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating instance_info_cache with network_info: [{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Releasing lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-35b781aa-5036-423c-8a47-68413d8d45a8 req-e9e3d1bd-0be1-424e-ae04-cf481e851cdf service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received event network-vif-plugged-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-35b781aa-5036-423c-8a47-68413d8d45a8 req-e9e3d1bd-0be1-424e-ae04-cf481e851cdf service nova] Acquiring lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-35b781aa-5036-423c-8a47-68413d8d45a8 req-e9e3d1bd-0be1-424e-ae04-cf481e851cdf service nova] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-35b781aa-5036-423c-8a47-68413d8d45a8 req-e9e3d1bd-0be1-424e-ae04-cf481e851cdf service nova] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.compute.manager [req-35b781aa-5036-423c-8a47-68413d8d45a8 req-e9e3d1bd-0be1-424e-ae04-cf481e851cdf service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] No waiting events found dispatching network-vif-plugged-50f0b635-1709-4aa2-b245-31909fd6dcfc {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:15:46 user nova-compute[75260]: WARNING nova.compute.manager [req-35b781aa-5036-423c-8a47-68413d8d45a8 req-e9e3d1bd-0be1-424e-ae04-cf481e851cdf service nova] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Received unexpected event network-vif-plugged-50f0b635-1709-4aa2-b245-31909fd6dcfc for instance with vm_state active and task_state deleting.
Nov 27 05:15:46 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Instance destroyed successfully.
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.objects.instance [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'resources' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-470052070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-470052070',id=49,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ElAOVom6TMKzYKJcPtfXG6rzQb1nQgeQGu0a6CHhNkbpKQRYE6OJ+pH7SSU1yBVxWgP22smTKQeApkW2XgvVE6023uIyFrbhnBD2auqrXIZvuqMIg6eL7CxuHMp1CcQ==',key_name='tempest-keypair-422796876',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:13:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-9q07jitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member',shelved_at='2023-11-27T05:15:45.456075',shelved_host='user',shelved_image_id='07f068e8-c528-4190-9659-e8017bdb6218'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=ae105a4c-292a-4e8f-8ba3-f8a049f36c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG os_vif [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5a5a85b-a5, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af573a1c-ffd7-431d-862e-8555168ae822) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:15:46 user nova-compute[75260]: INFO os_vif [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5')
Nov 27 05:15:46 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Deleting instance files /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18_del
Nov 27 05:15:46 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Deletion of /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18_del complete
Nov 27 05:15:46 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Deleted allocations for instance ae105a4c-292a-4e8f-8ba3-f8a049f36c18
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.objects.instance [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'numa_topology' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:15:46 user nova-compute[75260]: INFO nova.compute.manager [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: d219b714-0bca-4cc1-ac95-ec6c06564cfa] Took 0.83 seconds to detach 1 volumes for instance.
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.objects.base [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Object Instance<ae105a4c-292a-4e8f-8ba3-f8a049f36c18> lazy-loaded attributes: resources,numa_topology {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.073s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-5c710ae9-fd5a-4490-99ec-6bfc868a3019 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.983s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.127s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:15:46 user nova-compute[75260]: INFO nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] During sync_power_state the instance has a pending task (shelving_image_uploading). Skip.
Nov 27 05:15:46 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:15:46 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:15:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:47 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Deleted allocations for instance d219b714-0bca-4cc1-ac95-ec6c06564cfa
Nov 27 05:15:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-8d0d88fa-d74e-4c8f-bf9b-1d7bf2650505 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "d219b714-0bca-4cc1-ac95-ec6c06564cfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.222s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:15:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:51 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:52 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:15:56 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:01 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:16:06 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:07 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:16:08 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:16:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:16:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:16:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 05:16:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 05:16:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:16:11 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:16:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:16:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:16:14 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:16:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:16:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:16:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:16:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:16:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:16:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:16:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=9066MB free_disk=25.177268981933594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:16:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:16:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:16:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:16:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:16:15 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:16:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:16:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:16:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:16:16 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:18 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:16:21 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:31 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:16:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:16:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:16:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:16:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:16:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:16:35 user nova-compute[75260]: INFO nova.compute.claims [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Claim successful on node user
Nov 27 05:16:36 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:16:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:16:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG nova.policy [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bbd9c9317ac4d34ad23932bb35bcc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b302e83cda4b6bacc8e613016c8189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:16:36 user nova-compute[75260]: INFO nova.virt.block_device [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Booting with volume fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 at /dev/vda
Nov 27 05:16:36 user nova-compute[75260]: DEBUG os_brick.utils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[363d81ad-6c2c-404d-bd17-6617b233b446]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9c3c08-4613-423a-bd42-ce4d7debd2af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[390c66a4-5345-4c4c-a4fe-fa01b3c88064]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2364720-a1ef-4ba9-b821-0bccefe476da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:16:36 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:16:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a261e1a-00c7-4226-8388-5d91a4943a8b]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG os_brick.utils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updating existing volume attachment record: 3d9fd000-13a0-4d2e-be8a-733484b14884 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:16:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Successfully created port: 6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Successfully updated port: 6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquired lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-81d4db3c-8432-418d-83f3-fe3f516abaae req-6c8d3772-53c2-4c17-a7f9-8ac63e9d3e46 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received event network-changed-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-81d4db3c-8432-418d-83f3-fe3f516abaae req-6c8d3772-53c2-4c17-a7f9-8ac63e9d3e46 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Refreshing instance network info cache due to event network-changed-6e756b4b-f7f1-4b87-a306-15401e182fe4. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-81d4db3c-8432-418d-83f3-fe3f516abaae req-6c8d3772-53c2-4c17-a7f9-8ac63e9d3e46 service nova] Acquiring lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updating instance_info_cache with network_info: [{"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Releasing lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Instance network_info: |[{"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-81d4db3c-8432-418d-83f3-fe3f516abaae req-6c8d3772-53c2-4c17-a7f9-8ac63e9d3e46 service nova] Acquired lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:16:37 user nova-compute[75260]: DEBUG nova.network.neutron [req-81d4db3c-8432-418d-83f3-fe3f516abaae req-6c8d3772-53c2-4c17-a7f9-8ac63e9d3e46 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Refreshing network info cache for port 6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:16:38 user nova-compute[75260]: DEBUG nova.network.neutron [req-81d4db3c-8432-418d-83f3-fe3f516abaae req-6c8d3772-53c2-4c17-a7f9-8ac63e9d3e46 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updated VIF entry in instance network info cache for port 6e756b4b-f7f1-4b87-a306-15401e182fe4. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:16:38 user nova-compute[75260]: DEBUG nova.network.neutron [req-81d4db3c-8432-418d-83f3-fe3f516abaae req-6c8d3772-53c2-4c17-a7f9-8ac63e9d3e46 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updating instance_info_cache with network_info: [{"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:16:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-81d4db3c-8432-418d-83f3-fe3f516abaae req-6c8d3772-53c2-4c17-a7f9-8ac63e9d3e46 service nova] Releasing lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:16:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:16:42 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Creating image(s)
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Ensure instance console log exists: /opt/stack/data/nova/instances/7f5b79fb-c49b-462f-aba3-f83cbe27325e/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Start _get_guest_xml network_info=[{"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '3d9fd000-13a0-4d2e-be8a-733484b14884', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLjDAogv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7f5b79fb-c49b-462f-aba3-f83cbe27325e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 'serial': 'fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:16:42 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:16:42 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLjDAogv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:16:42 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:16:42 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:16:42 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12e43dd-772e-47c7-ad29-64412fe50c45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:16:42 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa501dd-93fa-4c79-bfbc-dd9ad65563c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788] added
Nov 27 05:16:42 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d58e8c3-b62d-4a9f-a2a3-bc6ca63de2e4]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f8877e-ae72-4030-8499-49af2927b59f]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLjDAogv {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLjDAogv" returned: 0 in 0.027s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ee7d3b-04c7-44b0-ba2b-e761eb324a59]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yLjDAogv'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c0a903-d9e6-403e-a5a4-d7f100fe0766]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ae69e-f25a-4f18-808d-9728d50fbb49]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 05:16:42 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 05:16:42 user nova-compute[75260]:  {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:16:42 user nova-compute[75260]: WARNING os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 05:16:42 user nova-compute[75260]: 
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da07046-092c-453c-83b9-3c042cd97a50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260]
Nov 27 05:16:42 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260] successful.
Nov 27 05:16:42 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7f6895-fe47-44ca-ae98-f08b1bfd0335]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ee7b9-50dc-4123-9827-82bb49faadc4]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:16:42 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:16:42 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a3b049-db1c-4cbc-9538-0ea833b57152]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:16:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLjDAogv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23162623163616439', 'path': '/dev/sdb'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162623163616439', 'path': '/dev/sdb'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-450263254',display_name='tempest-TestVolumeBootPattern-server-450263254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-450263254',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxjZgWBkC0vDIW+qP/oRdSAxQoY7m7bOeoA2c9MMZIbWYe3A6sjz1pgcrW4HTR4ErkM9d3sc/JlyOUNttSfKV4iyZ0ArGo73rhxgqnOA8qA96OB7kCqJ04RO/xhIBEqBg==',key_name='tempest-TestVolumeBootPattern-141657573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-pzjzlvwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:16:36Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=7f5b79fb-c49b-462f-aba3-f83cbe27325e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:f5,bridge_name='br-int',has_traffic_filtering=True,id=6e756b4b-f7f1-4b87-a306-15401e182fe4,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e756b4b-f7') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.objects.instance [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f5b79fb-c49b-462f-aba3-f83cbe27325e {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:16:43 user nova-compute[75260]:   <uuid>7f5b79fb-c49b-462f-aba3-f83cbe27325e</uuid>
Nov 27 05:16:43 user nova-compute[75260]:   <name>instance-00000033</name>
Nov 27 05:16:43 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:16:43 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:16:43 user nova-compute[75260]:   <metadata>
Nov 27 05:16:43 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:16:43 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:16:43 user nova-compute[75260]:       <nova:name>tempest-TestVolumeBootPattern-server-450263254</nova:name>
Nov 27 05:16:43 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:16:42</nova:creationTime>
Nov 27 05:16:43 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:16:43 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:16:43 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:16:43 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:16:43 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:16:43 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:16:43 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:16:43 user nova-compute[75260]:       <nova:owner>
Nov 27 05:16:43 user nova-compute[75260]:         <nova:user uuid="5bbd9c9317ac4d34ad23932bb35bcc87">tempest-TestVolumeBootPattern-1806325901-project-member</nova:user>
Nov 27 05:16:43 user nova-compute[75260]:         <nova:project uuid="c4b302e83cda4b6bacc8e613016c8189">tempest-TestVolumeBootPattern-1806325901</nova:project>
Nov 27 05:16:43 user nova-compute[75260]:       </nova:owner>
Nov 27 05:16:43 user nova-compute[75260]:       <nova:ports>
Nov 27 05:16:43 user nova-compute[75260]:         <nova:port uuid="6e756b4b-f7f1-4b87-a306-15401e182fe4">
Nov 27 05:16:43 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 05:16:43 user nova-compute[75260]:         </nova:port>
Nov 27 05:16:43 user nova-compute[75260]:       </nova:ports>
Nov 27 05:16:43 user nova-compute[75260]:     </nova:instance>
Nov 27 05:16:43 user nova-compute[75260]:   </metadata>
Nov 27 05:16:43 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:16:43 user nova-compute[75260]:     <system>
Nov 27 05:16:43 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:16:43 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:16:43 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:16:43 user nova-compute[75260]:       <entry name="serial">7f5b79fb-c49b-462f-aba3-f83cbe27325e</entry>
Nov 27 05:16:43 user nova-compute[75260]:       <entry name="uuid">7f5b79fb-c49b-462f-aba3-f83cbe27325e</entry>
Nov 27 05:16:43 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:16:43 user nova-compute[75260]:     </system>
Nov 27 05:16:43 user nova-compute[75260]:   </sysinfo>
Nov 27 05:16:43 user nova-compute[75260]:   <os>
Nov 27 05:16:43 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:16:43 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:16:43 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:16:43 user nova-compute[75260]:   </os>
Nov 27 05:16:43 user nova-compute[75260]:   <features>
Nov 27 05:16:43 user nova-compute[75260]:     <acpi/>
Nov 27 05:16:43 user nova-compute[75260]:     <apic/>
Nov 27 05:16:43 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:16:43 user nova-compute[75260]:   </features>
Nov 27 05:16:43 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:16:43 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:16:43 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:16:43 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:16:43 user nova-compute[75260]:   </clock>
Nov 27 05:16:43 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:16:43 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:16:43 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:16:43 user nova-compute[75260]:   </cpu>
Nov 27 05:16:43 user nova-compute[75260]:   <devices>
Nov 27 05:16:43 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:16:43 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:16:43 user nova-compute[75260]:       <source dev="/dev/sdb"/>
Nov 27 05:16:43 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:16:43 user nova-compute[75260]:       <serial>fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788</serial>
Nov 27 05:16:43 user nova-compute[75260]:     </disk>
Nov 27 05:16:43 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:16:43 user nova-compute[75260]:       <mac address="fa:16:3e:05:d3:f5"/>
Nov 27 05:16:43 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:16:43 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:16:43 user nova-compute[75260]:       <target dev="tap6e756b4b-f7"/>
Nov 27 05:16:43 user nova-compute[75260]:     </interface>
Nov 27 05:16:43 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:16:43 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/7f5b79fb-c49b-462f-aba3-f83cbe27325e/console.log" append="off"/>
Nov 27 05:16:43 user nova-compute[75260]:     </serial>
Nov 27 05:16:43 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:16:43 user nova-compute[75260]:     <video>
Nov 27 05:16:43 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:16:43 user nova-compute[75260]:     </video>
Nov 27 05:16:43 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:16:43 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:16:43 user nova-compute[75260]:     </rng>
Nov 27 05:16:43 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:16:43 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:16:43 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:16:43 user nova-compute[75260]:     </memballoon>
Nov 27 05:16:43 user nova-compute[75260]:   </devices>
Nov 27 05:16:43 user nova-compute[75260]: </domain>
Nov 27 05:16:43 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-450263254',display_name='tempest-TestVolumeBootPattern-server-450263254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-450263254',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxjZgWBkC0vDIW+qP/oRdSAxQoY7m7bOeoA2c9MMZIbWYe3A6sjz1pgcrW4HTR4ErkM9d3sc/JlyOUNttSfKV4iyZ0ArGo73rhxgqnOA8qA96OB7kCqJ04RO/xhIBEqBg==',key_name='tempest-TestVolumeBootPattern-141657573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-pzjzlvwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:16:36Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=7f5b79fb-c49b-462f-aba3-f83cbe27325e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:f5,bridge_name='br-int',has_traffic_filtering=True,id=6e756b4b-f7f1-4b87-a306-15401e182fe4,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e756b4b-f7') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG os_vif [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:f5,bridge_name='br-int',has_traffic_filtering=True,id=6e756b4b-f7f1-4b87-a306-15401e182fe4,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e756b4b-f7') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6206b6be-667a-5c64-8709-5206650e577d', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e756b4b-f7, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e756b4b-f7, col_values=(('qos', UUID('43f9f1d2-0c07-47d7-b20e-26c21cd4de0b')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e756b4b-f7, col_values=(('external_ids', {'iface-id': '6e756b4b-f7f1-4b87-a306-15401e182fe4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:d3:f5', 'vm-uuid': '7f5b79fb-c49b-462f-aba3-f83cbe27325e'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:43 user nova-compute[75260]: INFO os_vif [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:f5,bridge_name='br-int',has_traffic_filtering=True,id=6e756b4b-f7f1-4b87-a306-15401e182fe4,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e756b4b-f7')
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:16:43 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No VIF found with MAC fa:16:3e:05:d3:f5, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-7779ef41-97aa-46a8-831c-da7e1401afee req-1748aff9-e1d0-4340-8186-a3219461339d service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received event network-vif-plugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7779ef41-97aa-46a8-831c-da7e1401afee req-1748aff9-e1d0-4340-8186-a3219461339d service nova] Acquiring lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7779ef41-97aa-46a8-831c-da7e1401afee req-1748aff9-e1d0-4340-8186-a3219461339d service nova] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-7779ef41-97aa-46a8-831c-da7e1401afee req-1748aff9-e1d0-4340-8186-a3219461339d service nova] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-7779ef41-97aa-46a8-831c-da7e1401afee req-1748aff9-e1d0-4340-8186-a3219461339d service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] No waiting events found dispatching network-vif-plugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:16:45 user nova-compute[75260]: WARNING nova.compute.manager [req-7779ef41-97aa-46a8-831c-da7e1401afee req-1748aff9-e1d0-4340-8186-a3219461339d service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received unexpected event network-vif-plugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 for instance with vm_state building and task_state spawning.
Nov 27 05:16:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:16:47 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Instance spawned successfully.
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:16:47 user nova-compute[75260]: INFO nova.compute.manager [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-b361d7a8-0a00-4ca4-a117-9e2f6d32e744 req-a03d0d70-6aa7-4008-8f87-dd504a25d7b5 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received event network-vif-plugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b361d7a8-0a00-4ca4-a117-9e2f6d32e744 req-a03d0d70-6aa7-4008-8f87-dd504a25d7b5 service nova] Acquiring lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b361d7a8-0a00-4ca4-a117-9e2f6d32e744 req-a03d0d70-6aa7-4008-8f87-dd504a25d7b5 service nova] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-b361d7a8-0a00-4ca4-a117-9e2f6d32e744 req-a03d0d70-6aa7-4008-8f87-dd504a25d7b5 service nova] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-b361d7a8-0a00-4ca4-a117-9e2f6d32e744 req-a03d0d70-6aa7-4008-8f87-dd504a25d7b5 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] No waiting events found dispatching network-vif-plugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:16:47 user nova-compute[75260]: WARNING nova.compute.manager [req-b361d7a8-0a00-4ca4-a117-9e2f6d32e744 req-a03d0d70-6aa7-4008-8f87-dd504a25d7b5 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received unexpected event network-vif-plugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 for instance with vm_state building and task_state spawning.
Nov 27 05:16:47 user nova-compute[75260]: INFO nova.compute.manager [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Took 11.68 seconds to build instance.
Nov 27 05:16:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-f3ca2269-f6f8-4f48-b600-372441679352 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.782s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:16:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:16:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:17:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:07 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:17:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:17:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:17:09 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 05:17:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:17:09 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:17:09 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:17:09 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid 7f5b79fb-c49b-462f-aba3-f83cbe27325e {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:17:10 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updating instance_info_cache with network_info: [{"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:17:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:17:10 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:17:10 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:17:11 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:17:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:17:14 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:17:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:17:14 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:17:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:17:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:17:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:17:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:17:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:17:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:17:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:17:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=25.17559051513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:17:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:17:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:17:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7f5b79fb-c49b-462f-aba3-f83cbe27325e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:17:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:17:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:17:15 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:17:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:17:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:17:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:17:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:19 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:17:20 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:17:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:17:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:17:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:17:33 user nova-compute[75260]: INFO nova.compute.manager [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Unshelving
Nov 27 05:17:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:17:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:17:33 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'pci_requests' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:17:33 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'numa_topology' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:17:33 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:17:33 user nova-compute[75260]: INFO nova.compute.claims [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Claim successful on node user
Nov 27 05:17:33 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:17:33 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:17:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:33 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:17:33 user nova-compute[75260]: INFO nova.network.neutron [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating port a5a5a85b-a565-4da7-b1bd-b310950edafd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 27 05:17:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:17:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquired lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:17:34 user nova-compute[75260]: DEBUG nova.network.neutron [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:17:34 user nova-compute[75260]: DEBUG nova.compute.manager [req-f67fc2be-3f98-4f8d-a5d4-f39186f0ecbe req-77c43b3e-de8d-415d-b152-b6435e2bf31c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-changed-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:17:34 user nova-compute[75260]: DEBUG nova.compute.manager [req-f67fc2be-3f98-4f8d-a5d4-f39186f0ecbe req-77c43b3e-de8d-415d-b152-b6435e2bf31c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Refreshing instance network info cache due to event network-changed-a5a5a85b-a565-4da7-b1bd-b310950edafd. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:17:34 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f67fc2be-3f98-4f8d-a5d4-f39186f0ecbe req-77c43b3e-de8d-415d-b152-b6435e2bf31c service nova] Acquiring lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG nova.network.neutron [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating instance_info_cache with network_info: [{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Releasing lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:17:35 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Creating image(s)
Nov 27 05:17:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "/opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "/opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'trusted_certs' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f67fc2be-3f98-4f8d-a5d4-f39186f0ecbe req-77c43b3e-de8d-415d-b152-b6435e2bf31c service nova] Acquired lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG nova.network.neutron [req-f67fc2be-3f98-4f8d-a5d4-f39186f0ecbe req-77c43b3e-de8d-415d-b152-b6435e2bf31c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Refreshing network info cache for port a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG nova.objects.base [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Object Instance<ae105a4c-292a-4e8f-8ba3-f8a049f36c18> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "03e6afffc58cb49c6dabcb0298f3579a3674f322" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:17:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "03e6afffc58cb49c6dabcb0298f3579a3674f322" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:17:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322.part --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:17:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:17:36 user nova-compute[75260]: DEBUG nova.virt.images [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] 07f068e8-c528-4190-9659-e8017bdb6218 was qcow2, converting to raw {{(pid=75260) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 05:17:36 user nova-compute[75260]: DEBUG nova.privsep.utils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75260) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 05:17:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322.part /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322.converted {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:17:36 user nova-compute[75260]: DEBUG nova.network.neutron [req-f67fc2be-3f98-4f8d-a5d4-f39186f0ecbe req-77c43b3e-de8d-415d-b152-b6435e2bf31c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updated VIF entry in instance network info cache for port a5a5a85b-a565-4da7-b1bd-b310950edafd. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:17:36 user nova-compute[75260]: DEBUG nova.network.neutron [req-f67fc2be-3f98-4f8d-a5d4-f39186f0ecbe req-77c43b3e-de8d-415d-b152-b6435e2bf31c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating instance_info_cache with network_info: [{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:17:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-f67fc2be-3f98-4f8d-a5d4-f39186f0ecbe req-77c43b3e-de8d-415d-b152-b6435e2bf31c service nova] Releasing lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322.part /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322.converted" returned: 0 in 0.533s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322.converted --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "03e6afffc58cb49c6dabcb0298f3579a3674f322" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.072s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322 --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "03e6afffc58cb49c6dabcb0298f3579a3674f322" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "03e6afffc58cb49c6dabcb0298f3579a3674f322" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322 --force-share --output=json" returned: 0 in 0.173s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322,backing_fmt=raw /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk 1073741824 {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322,backing_fmt=raw /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk 1073741824" returned: 0 in 0.050s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "03e6afffc58cb49c6dabcb0298f3579a3674f322" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03e6afffc58cb49c6dabcb0298f3579a3674f322 --force-share --output=json" returned: 0 in 0.174s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'migration_context' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:17:37 user nova-compute[75260]: DEBUG nova.objects.base [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Object Instance<ae105a4c-292a-4e8f-8ba3-f8a049f36c18> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:17:37 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Rebasing disk image.
Nov 27 05:17:37 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:17:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:17:38 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 -F raw /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:17:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9f2da9023fef25b51ca7893a009fc51f3632d86 -F raw /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk" returned: 0 in 2.320s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Created local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Ensure instance console log exists: /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Start _get_guest_xml network_info=[{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='77fff8a190c1469f15fcb12d85056e21',container_format='bare',created_at=2023-11-27T05:15:41Z,direct_url=<?>,disk_format='qcow2',id=07f068e8-c528-4190-9659-e8017bdb6218,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-470052070-shelved',owner='c1ba48818d9d412da1471e0f56125dec',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-27T05:15:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'a58facc7-83af-4098-886e-ccf8b18b0095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:17:40 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:17:40 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='77fff8a190c1469f15fcb12d85056e21',container_format='bare',created_at=2023-11-27T05:15:41Z,direct_url=<?>,disk_format='qcow2',id=07f068e8-c528-4190-9659-e8017bdb6218,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-470052070-shelved',owner='c1ba48818d9d412da1471e0f56125dec',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-27T05:15:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.objects.base [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Object Instance<ae105a4c-292a-4e8f-8ba3-f8a049f36c18> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T05:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-470052070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-470052070',id=49,image_ref='07f068e8-c528-4190-9659-e8017bdb6218',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-422796876',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:13:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-9q07jitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member',shelved_at='2023-11-27T05:15:45.456075',shelved_host='user',shelved_image_id='07f068e8-c528-4190-9659-e8017bdb6218'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=ae105a4c-292a-4e8f-8ba3-f8a049f36c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.objects.instance [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'pci_devices' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.objects.base [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Object Instance<ae105a4c-292a-4e8f-8ba3-f8a049f36c18> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75260) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:17:40 user nova-compute[75260]:   <uuid>ae105a4c-292a-4e8f-8ba3-f8a049f36c18</uuid>
Nov 27 05:17:40 user nova-compute[75260]:   <name>instance-00000031</name>
Nov 27 05:17:40 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:17:40 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:17:40 user nova-compute[75260]:   <metadata>
Nov 27 05:17:40 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:17:40 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:17:40 user nova-compute[75260]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-470052070</nova:name>
Nov 27 05:17:40 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:17:40</nova:creationTime>
Nov 27 05:17:40 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:17:40 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:17:40 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:17:40 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:17:40 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:17:40 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:17:40 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:17:40 user nova-compute[75260]:       <nova:owner>
Nov 27 05:17:40 user nova-compute[75260]:         <nova:user uuid="0bfa8522667f4592bc4bfb0712b6b1f7">tempest-AttachVolumeShelveTestJSON-1008190038-project-member</nova:user>
Nov 27 05:17:40 user nova-compute[75260]:         <nova:project uuid="c1ba48818d9d412da1471e0f56125dec">tempest-AttachVolumeShelveTestJSON-1008190038</nova:project>
Nov 27 05:17:40 user nova-compute[75260]:       </nova:owner>
Nov 27 05:17:40 user nova-compute[75260]:       <nova:root type="image" uuid="07f068e8-c528-4190-9659-e8017bdb6218"/>
Nov 27 05:17:40 user nova-compute[75260]:       <nova:ports>
Nov 27 05:17:40 user nova-compute[75260]:         <nova:port uuid="a5a5a85b-a565-4da7-b1bd-b310950edafd">
Nov 27 05:17:40 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 05:17:40 user nova-compute[75260]:         </nova:port>
Nov 27 05:17:40 user nova-compute[75260]:       </nova:ports>
Nov 27 05:17:40 user nova-compute[75260]:     </nova:instance>
Nov 27 05:17:40 user nova-compute[75260]:   </metadata>
Nov 27 05:17:40 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:17:40 user nova-compute[75260]:     <system>
Nov 27 05:17:40 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:17:40 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:17:40 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:17:40 user nova-compute[75260]:       <entry name="serial">ae105a4c-292a-4e8f-8ba3-f8a049f36c18</entry>
Nov 27 05:17:40 user nova-compute[75260]:       <entry name="uuid">ae105a4c-292a-4e8f-8ba3-f8a049f36c18</entry>
Nov 27 05:17:40 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:17:40 user nova-compute[75260]:     </system>
Nov 27 05:17:40 user nova-compute[75260]:   </sysinfo>
Nov 27 05:17:40 user nova-compute[75260]:   <os>
Nov 27 05:17:40 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:17:40 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:17:40 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:17:40 user nova-compute[75260]:   </os>
Nov 27 05:17:40 user nova-compute[75260]:   <features>
Nov 27 05:17:40 user nova-compute[75260]:     <acpi/>
Nov 27 05:17:40 user nova-compute[75260]:     <apic/>
Nov 27 05:17:40 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:17:40 user nova-compute[75260]:   </features>
Nov 27 05:17:40 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:17:40 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:17:40 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:17:40 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:17:40 user nova-compute[75260]:   </clock>
Nov 27 05:17:40 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:17:40 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:17:40 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:17:40 user nova-compute[75260]:   </cpu>
Nov 27 05:17:40 user nova-compute[75260]:   <devices>
Nov 27 05:17:40 user nova-compute[75260]:     <disk type="file" device="disk">
Nov 27 05:17:40 user nova-compute[75260]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 05:17:40 user nova-compute[75260]:       <source file="/opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk"/>
Nov 27 05:17:40 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:17:40 user nova-compute[75260]:     </disk>
Nov 27 05:17:40 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:17:40 user nova-compute[75260]:       <mac address="fa:16:3e:e1:83:da"/>
Nov 27 05:17:40 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:17:40 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:17:40 user nova-compute[75260]:       <target dev="tapa5a5a85b-a5"/>
Nov 27 05:17:40 user nova-compute[75260]:     </interface>
Nov 27 05:17:40 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:17:40 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/console.log" append="off"/>
Nov 27 05:17:40 user nova-compute[75260]:     </serial>
Nov 27 05:17:40 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:17:40 user nova-compute[75260]:     <video>
Nov 27 05:17:40 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:17:40 user nova-compute[75260]:     </video>
Nov 27 05:17:40 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:17:40 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:17:40 user nova-compute[75260]:     </rng>
Nov 27 05:17:40 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:17:40 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:17:40 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:17:40 user nova-compute[75260]:     </memballoon>
Nov 27 05:17:40 user nova-compute[75260]:   </devices>
Nov 27 05:17:40 user nova-compute[75260]: </domain>
Nov 27 05:17:40 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T05:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-470052070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-470052070',id=49,image_ref='07f068e8-c528-4190-9659-e8017bdb6218',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-422796876',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:13:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-9q07jitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member',shelved_at='2023-11-27T05:15:45.456075',shelved_host='user',shelved_image_id='07f068e8-c528-4190-9659-e8017bdb6218'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=ae105a4c-292a-4e8f-8ba3-f8a049f36c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG os_vif [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6f8c5de-d7b1-5145-a606-21bfc8d0c975', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5a5a85b-a5, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5a5a85b-a5, col_values=(('qos', UUID('d6203981-65ae-45c9-aa69-231d58c6b47f')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5a5a85b-a5, col_values=(('external_ids', {'iface-id': 'a5a5a85b-a565-4da7-b1bd-b310950edafd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:83:da', 'vm-uuid': 'ae105a4c-292a-4e8f-8ba3-f8a049f36c18'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:40 user nova-compute[75260]: INFO os_vif [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5')
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:17:40 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] No VIF found with MAC fa:16:3e:e1:83:da, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:17:41 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG nova.compute.manager [req-17b24ba5-541c-410d-b8ab-3c352328ee8d req-2d660317-a9cd-4a5e-b637-1089f940b3c7 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-17b24ba5-541c-410d-b8ab-3c352328ee8d req-2d660317-a9cd-4a5e-b637-1089f940b3c7 service nova] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-17b24ba5-541c-410d-b8ab-3c352328ee8d req-2d660317-a9cd-4a5e-b637-1089f940b3c7 service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-17b24ba5-541c-410d-b8ab-3c352328ee8d req-2d660317-a9cd-4a5e-b637-1089f940b3c7 service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG nova.compute.manager [req-17b24ba5-541c-410d-b8ab-3c352328ee8d req-2d660317-a9cd-4a5e-b637-1089f940b3c7 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] No waiting events found dispatching network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:17:42 user nova-compute[75260]: WARNING nova.compute.manager [req-17b24ba5-541c-410d-b8ab-3c352328ee8d req-2d660317-a9cd-4a5e-b637-1089f940b3c7 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received unexpected event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 05:17:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-1323f92a-7854-4da8-a325-1a42f4c50afd req-cb50ab01-a824-4564-b2cd-eb5461d2579c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:17:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1323f92a-7854-4da8-a325-1a42f4c50afd req-cb50ab01-a824-4564-b2cd-eb5461d2579c service nova] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:17:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1323f92a-7854-4da8-a325-1a42f4c50afd req-cb50ab01-a824-4564-b2cd-eb5461d2579c service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:17:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1323f92a-7854-4da8-a325-1a42f4c50afd req-cb50ab01-a824-4564-b2cd-eb5461d2579c service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:17:44 user nova-compute[75260]: DEBUG nova.compute.manager [req-1323f92a-7854-4da8-a325-1a42f4c50afd req-cb50ab01-a824-4564-b2cd-eb5461d2579c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] No waiting events found dispatching network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:17:44 user nova-compute[75260]: WARNING nova.compute.manager [req-1323f92a-7854-4da8-a325-1a42f4c50afd req-cb50ab01-a824-4564-b2cd-eb5461d2579c service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received unexpected event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 05:17:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:17:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:17:44 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Instance spawned successfully.
Nov 27 05:17:44 user nova-compute[75260]: DEBUG nova.compute.manager [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:17:44 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-e87e4099-9601-4577-856f-f8622e2f8a18 tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.142s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:17:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:17:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:17:57 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:02 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:18:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:18:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:10 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:18:10 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:18:10 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 05:18:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:18:10 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:18:10 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:18:10 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid 7f5b79fb-c49b-462f-aba3-f83cbe27325e {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:18:11 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updating instance_info_cache with network_info: [{"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:18:11 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:18:11 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:18:11 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:18:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:12 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:18:14 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:18:14 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:18:14 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:18:14 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:18:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:18:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:18:14 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:18:14 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:18:14 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:18:15 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:18:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.141490936279297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7f5b79fb-c49b-462f-aba3-f83cbe27325e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance ae105a4c-292a-4e8f-8ba3-f8a049f36c18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:18:15 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:18:19 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:18:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:18:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:18:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:18:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:18:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:18:26 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-339f6998-1809-491c-b981-db7793ce2c1e req-e490b85e-d914-45f6-bd63-4020fed972d8 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received event network-changed-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:18:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-339f6998-1809-491c-b981-db7793ce2c1e req-e490b85e-d914-45f6-bd63-4020fed972d8 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Refreshing instance network info cache due to event network-changed-6e756b4b-f7f1-4b87-a306-15401e182fe4. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:18:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-339f6998-1809-491c-b981-db7793ce2c1e req-e490b85e-d914-45f6-bd63-4020fed972d8 service nova] Acquiring lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:18:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-339f6998-1809-491c-b981-db7793ce2c1e req-e490b85e-d914-45f6-bd63-4020fed972d8 service nova] Acquired lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:18:27 user nova-compute[75260]: DEBUG nova.network.neutron [req-339f6998-1809-491c-b981-db7793ce2c1e req-e490b85e-d914-45f6-bd63-4020fed972d8 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Refreshing network info cache for port 6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:18:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:27 user nova-compute[75260]: DEBUG nova.network.neutron [req-339f6998-1809-491c-b981-db7793ce2c1e req-e490b85e-d914-45f6-bd63-4020fed972d8 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updated VIF entry in instance network info cache for port 6e756b4b-f7f1-4b87-a306-15401e182fe4. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:18:27 user nova-compute[75260]: DEBUG nova.network.neutron [req-339f6998-1809-491c-b981-db7793ce2c1e req-e490b85e-d914-45f6-bd63-4020fed972d8 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updating instance_info_cache with network_info: [{"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:18:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-339f6998-1809-491c-b981-db7793ce2c1e req-e490b85e-d914-45f6-bd63-4020fed972d8 service nova] Releasing lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:18:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "a4ad6001-a83d-425f-b689-ee4c8af13be3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:18:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:18:35 user nova-compute[75260]: DEBUG nova.compute.manager [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Starting instance... {{(pid=75260) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 05:18:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:18:35 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:18:35 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75260) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 05:18:35 user nova-compute[75260]: INFO nova.compute.claims [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Claim successful on node user
Nov 27 05:18:36 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Start building networks asynchronously for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Allocating IP information in the background. {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG nova.network.neutron [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] allocate_for_instance() {{(pid=75260) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 05:18:36 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 05:18:36 user nova-compute[75260]: DEBUG nova.compute.manager [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Start building block device mappings for instance. {{(pid=75260) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG nova.policy [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bbd9c9317ac4d34ad23932bb35bcc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b302e83cda4b6bacc8e613016c8189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75260) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 05:18:36 user nova-compute[75260]: INFO nova.virt.block_device [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Booting with volume 86c94993-71ab-40a2-be34-a0a5d56b0293 at /dev/vda
Nov 27 05:18:36 user nova-compute[75260]: DEBUG os_brick.utils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2d6f8-96ba-4d1a-81ed-deabfcfc64ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a81a0921bf\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06931c8-78b8-463a-8be0-7270f1129522]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6355f1d9-3ac0-4f42-b755-402308face4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f331088-51b6-4548-83c1-0b79b2f5e238]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Running cmd (subprocess): nvme version {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.nvmeof [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] nvme not present on system {{(pid=75260) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 05:18:36 user nova-compute[75260]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 05:18:36 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[000183ab-4557-4dcf-917d-4454d356bbc0]: (4, '') {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75260) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.lightos [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] LIGHTOS: no hostnqn found. {{(pid=75260) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG os_brick.utils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a81a0921bf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:18:36 user nova-compute[75260]: DEBUG nova.virt.block_device [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Updating existing volume attachment record: 4049486d-7717-46cb-86b5-2156e253d711 {{(pid=75260) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 05:18:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Successfully created port: 41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 05:18:37 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Successfully updated port: 41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 05:18:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:18:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquired lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:18:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Building network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 05:18:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-9ba990ba-439f-433c-bc1b-f4898fa7a681 req-afb47f4b-5103-45cd-817b-e8414f30fd86 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received event network-changed-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:18:37 user nova-compute[75260]: DEBUG nova.compute.manager [req-9ba990ba-439f-433c-bc1b-f4898fa7a681 req-afb47f4b-5103-45cd-817b-e8414f30fd86 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Refreshing instance network info cache due to event network-changed-41fb055c-ebba-42f9-afb7-a66d87a38bee. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:18:37 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9ba990ba-439f-433c-bc1b-f4898fa7a681 req-afb47f4b-5103-45cd-817b-e8414f30fd86 service nova] Acquiring lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:18:37 user nova-compute[75260]: DEBUG nova.network.neutron [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Instance cache missing network info. {{(pid=75260) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 05:18:38 user nova-compute[75260]: DEBUG nova.network.neutron [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Updating instance_info_cache with network_info: [{"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:18:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Releasing lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:18:38 user nova-compute[75260]: DEBUG nova.compute.manager [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Instance network_info: |[{"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75260) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 05:18:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9ba990ba-439f-433c-bc1b-f4898fa7a681 req-afb47f4b-5103-45cd-817b-e8414f30fd86 service nova] Acquired lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:18:38 user nova-compute[75260]: DEBUG nova.network.neutron [req-9ba990ba-439f-433c-bc1b-f4898fa7a681 req-afb47f4b-5103-45cd-817b-e8414f30fd86 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Refreshing network info cache for port 41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:18:38 user nova-compute[75260]: DEBUG nova.network.neutron [req-9ba990ba-439f-433c-bc1b-f4898fa7a681 req-afb47f4b-5103-45cd-817b-e8414f30fd86 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Updated VIF entry in instance network info cache for port 41fb055c-ebba-42f9-afb7-a66d87a38bee. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:18:38 user nova-compute[75260]: DEBUG nova.network.neutron [req-9ba990ba-439f-433c-bc1b-f4898fa7a681 req-afb47f4b-5103-45cd-817b-e8414f30fd86 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Updating instance_info_cache with network_info: [{"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:18:38 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9ba990ba-439f-433c-bc1b-f4898fa7a681 req-afb47f4b-5103-45cd-817b-e8414f30fd86 service nova] Releasing lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:18:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.compute.manager [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Start spawning the instance on the hypervisor. {{(pid=75260) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Creating instance directory {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 05:18:42 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Creating image(s)
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Did not create local disks {{(pid=75260) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Ensure instance console log exists: /opt/stack/data/nova/instances/a4ad6001-a83d-425f-b689-ee4c8af13be3/console.log {{(pid=75260) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Start _get_guest_xml network_info=[{"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '4049486d-7717-46cb-86b5-2156e253d711', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMOhUkNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4ad6001-a83d-425f-b689-ee4c8af13be3', 'attached_at': '', 'detached_at': '', 'volume_id': '86c94993-71ab-40a2-be34-a0a5d56b0293', 'serial': '86c94993-71ab-40a2-be34-a0a5d56b0293'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None} {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 05:18:42 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:18:42 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller missing on host. {{(pid=75260) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.host [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU controller found on host. {{(pid=75260) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75260) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T04:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image limits 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flavor pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Image pref 0:0:0 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Got 1 possible topologies {{(pid=75260) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.hardware [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75260) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Calling os-brick to attach iSCSI Volume {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMOhUkNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:18:42 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:18:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:18:42 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:18:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:18:42 user nova-compute[75260]: INFO os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d5b97d-7359-45ff-8ec5-cb717c678b4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 05:18:42 user nova-compute[75260]:  {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --interface default --op new {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e1cfeb-3f9f-426f-9c30-c9b099e5a082]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293] added\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293] added
Nov 27 05:18:42 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ed7418-e419-40eb-840e-594c68de9ce8]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:18:42 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f34c30d-b52b-4eb2-bc33-42d7b5ebcda6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMOhUkNa {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMOhUkNa" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0de30cb-6fce-41a3-951f-69a90ca15c46]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CMOhUkNa'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49e8986-d75f-4d56-9c69-5f1d8209323a]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3b209c-47b5-42fa-ab89-a7a0e7cb3731]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:18:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:18:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --login {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d77543-8cd3-4417-a9b0-c5ff6b5b83d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293, portal: 172.16.0.220,3260]
Nov 27 05:18:43 user nova-compute[75260]: Login to [iface: default, target: iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293, portal: 172.16.0.220,3260] successful.
Nov 27 05:18:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f8143d-fc66-41fb-935d-cfb6f4bad3a2]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01f38ee-3fe1-4716-ac82-49b28e47ee8a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:18:43 user nova-compute[75260]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 (non-flash)
Nov 27 05:18:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:18:43 user nova-compute[75260]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 (non-flash)
Nov 27 05:18:43 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to 172.16.0.220:3260 {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=75260) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75260) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbbd4da-e658-466b-9d2d-a24b1e6b3b5f]: (4, ('- - 0', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75260) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 05:18:43 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMOhUkNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75260) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23230383562623964', 'path': '/dev/sdc'} {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230383562623964', 'path': '/dev/sdc'} {{(pid=75260) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082745135',display_name='tempest-TestVolumeBootPattern-server-2082745135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082745135',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxjZgWBkC0vDIW+qP/oRdSAxQoY7m7bOeoA2c9MMZIbWYe3A6sjz1pgcrW4HTR4ErkM9d3sc/JlyOUNttSfKV4iyZ0ArGo73rhxgqnOA8qA96OB7kCqJ04RO/xhIBEqBg==',key_name='tempest-TestVolumeBootPattern-141657573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-fmljlii4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:18:36Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=a4ad6001-a83d-425f-b689-ee4c8af13be3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75260) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:2a:c9,bridge_name='br-int',has_traffic_filtering=True,id=41fb055c-ebba-42f9-afb7-a66d87a38bee,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fb055c-eb') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.objects.instance [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'pci_devices' on Instance uuid a4ad6001-a83d-425f-b689-ee4c8af13be3 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] End _get_guest_xml xml=<domain type="kvm">
Nov 27 05:18:44 user nova-compute[75260]:   <uuid>a4ad6001-a83d-425f-b689-ee4c8af13be3</uuid>
Nov 27 05:18:44 user nova-compute[75260]:   <name>instance-00000034</name>
Nov 27 05:18:44 user nova-compute[75260]:   <memory>524288</memory>
Nov 27 05:18:44 user nova-compute[75260]:   <vcpu>1</vcpu>
Nov 27 05:18:44 user nova-compute[75260]:   <metadata>
Nov 27 05:18:44 user nova-compute[75260]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 05:18:44 user nova-compute[75260]:       <nova:package version="0.0.0"/>
Nov 27 05:18:44 user nova-compute[75260]:       <nova:name>tempest-TestVolumeBootPattern-server-2082745135</nova:name>
Nov 27 05:18:44 user nova-compute[75260]:       <nova:creationTime>2023-11-27 05:18:42</nova:creationTime>
Nov 27 05:18:44 user nova-compute[75260]:       <nova:flavor name="m1.tiny">
Nov 27 05:18:44 user nova-compute[75260]:         <nova:memory>512</nova:memory>
Nov 27 05:18:44 user nova-compute[75260]:         <nova:disk>1</nova:disk>
Nov 27 05:18:44 user nova-compute[75260]:         <nova:swap>0</nova:swap>
Nov 27 05:18:44 user nova-compute[75260]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 05:18:44 user nova-compute[75260]:         <nova:vcpus>1</nova:vcpus>
Nov 27 05:18:44 user nova-compute[75260]:       </nova:flavor>
Nov 27 05:18:44 user nova-compute[75260]:       <nova:owner>
Nov 27 05:18:44 user nova-compute[75260]:         <nova:user uuid="5bbd9c9317ac4d34ad23932bb35bcc87">tempest-TestVolumeBootPattern-1806325901-project-member</nova:user>
Nov 27 05:18:44 user nova-compute[75260]:         <nova:project uuid="c4b302e83cda4b6bacc8e613016c8189">tempest-TestVolumeBootPattern-1806325901</nova:project>
Nov 27 05:18:44 user nova-compute[75260]:       </nova:owner>
Nov 27 05:18:44 user nova-compute[75260]:       <nova:ports>
Nov 27 05:18:44 user nova-compute[75260]:         <nova:port uuid="41fb055c-ebba-42f9-afb7-a66d87a38bee">
Nov 27 05:18:44 user nova-compute[75260]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 05:18:44 user nova-compute[75260]:         </nova:port>
Nov 27 05:18:44 user nova-compute[75260]:       </nova:ports>
Nov 27 05:18:44 user nova-compute[75260]:     </nova:instance>
Nov 27 05:18:44 user nova-compute[75260]:   </metadata>
Nov 27 05:18:44 user nova-compute[75260]:   <sysinfo type="smbios">
Nov 27 05:18:44 user nova-compute[75260]:     <system>
Nov 27 05:18:44 user nova-compute[75260]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 05:18:44 user nova-compute[75260]:       <entry name="product">OpenStack Nova</entry>
Nov 27 05:18:44 user nova-compute[75260]:       <entry name="version">0.0.0</entry>
Nov 27 05:18:44 user nova-compute[75260]:       <entry name="serial">a4ad6001-a83d-425f-b689-ee4c8af13be3</entry>
Nov 27 05:18:44 user nova-compute[75260]:       <entry name="uuid">a4ad6001-a83d-425f-b689-ee4c8af13be3</entry>
Nov 27 05:18:44 user nova-compute[75260]:       <entry name="family">Virtual Machine</entry>
Nov 27 05:18:44 user nova-compute[75260]:     </system>
Nov 27 05:18:44 user nova-compute[75260]:   </sysinfo>
Nov 27 05:18:44 user nova-compute[75260]:   <os>
Nov 27 05:18:44 user nova-compute[75260]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 05:18:44 user nova-compute[75260]:     <boot dev="hd"/>
Nov 27 05:18:44 user nova-compute[75260]:     <smbios mode="sysinfo"/>
Nov 27 05:18:44 user nova-compute[75260]:   </os>
Nov 27 05:18:44 user nova-compute[75260]:   <features>
Nov 27 05:18:44 user nova-compute[75260]:     <acpi/>
Nov 27 05:18:44 user nova-compute[75260]:     <apic/>
Nov 27 05:18:44 user nova-compute[75260]:     <vmcoreinfo/>
Nov 27 05:18:44 user nova-compute[75260]:   </features>
Nov 27 05:18:44 user nova-compute[75260]:   <clock offset="utc">
Nov 27 05:18:44 user nova-compute[75260]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 05:18:44 user nova-compute[75260]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 05:18:44 user nova-compute[75260]:     <timer name="hpet" present="no"/>
Nov 27 05:18:44 user nova-compute[75260]:   </clock>
Nov 27 05:18:44 user nova-compute[75260]:   <cpu mode="custom" match="exact">
Nov 27 05:18:44 user nova-compute[75260]:     <model>Nehalem</model>
Nov 27 05:18:44 user nova-compute[75260]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 05:18:44 user nova-compute[75260]:   </cpu>
Nov 27 05:18:44 user nova-compute[75260]:   <devices>
Nov 27 05:18:44 user nova-compute[75260]:     <disk type="block" device="disk">
Nov 27 05:18:44 user nova-compute[75260]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 05:18:44 user nova-compute[75260]:       <source dev="/dev/sdc"/>
Nov 27 05:18:44 user nova-compute[75260]:       <target dev="vda" bus="virtio"/>
Nov 27 05:18:44 user nova-compute[75260]:       <serial>86c94993-71ab-40a2-be34-a0a5d56b0293</serial>
Nov 27 05:18:44 user nova-compute[75260]:     </disk>
Nov 27 05:18:44 user nova-compute[75260]:     <interface type="ethernet">
Nov 27 05:18:44 user nova-compute[75260]:       <mac address="fa:16:3e:83:2a:c9"/>
Nov 27 05:18:44 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:18:44 user nova-compute[75260]:       <mtu size="1442"/>
Nov 27 05:18:44 user nova-compute[75260]:       <target dev="tap41fb055c-eb"/>
Nov 27 05:18:44 user nova-compute[75260]:     </interface>
Nov 27 05:18:44 user nova-compute[75260]:     <serial type="pty">
Nov 27 05:18:44 user nova-compute[75260]:       <log file="/opt/stack/data/nova/instances/a4ad6001-a83d-425f-b689-ee4c8af13be3/console.log" append="off"/>
Nov 27 05:18:44 user nova-compute[75260]:     </serial>
Nov 27 05:18:44 user nova-compute[75260]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 05:18:44 user nova-compute[75260]:     <video>
Nov 27 05:18:44 user nova-compute[75260]:       <model type="virtio"/>
Nov 27 05:18:44 user nova-compute[75260]:     </video>
Nov 27 05:18:44 user nova-compute[75260]:     <rng model="virtio">
Nov 27 05:18:44 user nova-compute[75260]:       <backend model="random">/dev/urandom</backend>
Nov 27 05:18:44 user nova-compute[75260]:     </rng>
Nov 27 05:18:44 user nova-compute[75260]:     <controller type="usb" index="0" model="none"/>
Nov 27 05:18:44 user nova-compute[75260]:     <memballoon model="virtio">
Nov 27 05:18:44 user nova-compute[75260]:       <stats period="10"/>
Nov 27 05:18:44 user nova-compute[75260]:     </memballoon>
Nov 27 05:18:44 user nova-compute[75260]:   </devices>
Nov 27 05:18:44 user nova-compute[75260]: </domain>
Nov 27 05:18:44 user nova-compute[75260]:  {{(pid=75260) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082745135',display_name='tempest-TestVolumeBootPattern-server-2082745135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082745135',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxjZgWBkC0vDIW+qP/oRdSAxQoY7m7bOeoA2c9MMZIbWYe3A6sjz1pgcrW4HTR4ErkM9d3sc/JlyOUNttSfKV4iyZ0ArGo73rhxgqnOA8qA96OB7kCqJ04RO/xhIBEqBg==',key_name='tempest-TestVolumeBootPattern-141657573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-fmljlii4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T05:18:36Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=a4ad6001-a83d-425f-b689-ee4c8af13be3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:2a:c9,bridge_name='br-int',has_traffic_filtering=True,id=41fb055c-ebba-42f9-afb7-a66d87a38bee,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fb055c-eb') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG os_vif [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:2a:c9,bridge_name='br-int',has_traffic_filtering=True,id=41fb055c-ebba-42f9-afb7-a66d87a38bee,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fb055c-eb') {{(pid=75260) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '019bfe63-efc2-5c6c-a8cb-afdef2d58d89', '_type': 'linux-noop'}}, row=False) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41fb055c-eb, may_exist=True, interface_attrs={}) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41fb055c-eb, col_values=(('qos', UUID('67ec0417-1a40-41df-891e-168070f69e1a')),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41fb055c-eb, col_values=(('external_ids', {'iface-id': '41fb055c-ebba-42f9-afb7-a66d87a38bee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:2a:c9', 'vm-uuid': 'a4ad6001-a83d-425f-b689-ee4c8af13be3'}),), if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:44 user nova-compute[75260]: INFO os_vif [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:2a:c9,bridge_name='br-int',has_traffic_filtering=True,id=41fb055c-ebba-42f9-afb7-a66d87a38bee,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fb055c-eb')
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75260) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 05:18:44 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] No VIF found with MAC fa:16:3e:83:2a:c9, not building metadata {{(pid=75260) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 05:18:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-76749b00-4b00-4299-bfc3-01f7d5d04a06 req-3b29c381-e431-43b2-b320-e39d3d9b570f service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received event network-vif-plugged-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:18:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-76749b00-4b00-4299-bfc3-01f7d5d04a06 req-3b29c381-e431-43b2-b320-e39d3d9b570f service nova] Acquiring lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:18:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-76749b00-4b00-4299-bfc3-01f7d5d04a06 req-3b29c381-e431-43b2-b320-e39d3d9b570f service nova] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:18:45 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-76749b00-4b00-4299-bfc3-01f7d5d04a06 req-3b29c381-e431-43b2-b320-e39d3d9b570f service nova] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:18:45 user nova-compute[75260]: DEBUG nova.compute.manager [req-76749b00-4b00-4299-bfc3-01f7d5d04a06 req-3b29c381-e431-43b2-b320-e39d3d9b570f service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] No waiting events found dispatching network-vif-plugged-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:18:45 user nova-compute[75260]: WARNING nova.compute.manager [req-76749b00-4b00-4299-bfc3-01f7d5d04a06 req-3b29c381-e431-43b2-b320-e39d3d9b570f service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received unexpected event network-vif-plugged-41fb055c-ebba-42f9-afb7-a66d87a38bee for instance with vm_state building and task_state spawning.
Nov 27 05:18:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Instance event wait completed in 0 seconds for  {{(pid=75260) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Guest created on hypervisor {{(pid=75260) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 05:18:47 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Instance spawned successfully.
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Found default for hw_cdrom_bus of ide {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Found default for hw_disk_bus of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Found default for hw_input_bus of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Found default for hw_pointer_model of None {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Found default for hw_video_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Found default for hw_vif_model of virtio {{(pid=75260) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:47 user nova-compute[75260]: INFO nova.compute.manager [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.compute.manager [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Checking state {{(pid=75260) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-9b3f8b2c-181b-46a7-9a64-c53b41b1d308 req-ba64ecc2-41ef-4304-8f9f-86313a22c4ee service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received event network-vif-plugged-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b3f8b2c-181b-46a7-9a64-c53b41b1d308 req-ba64ecc2-41ef-4304-8f9f-86313a22c4ee service nova] Acquiring lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b3f8b2c-181b-46a7-9a64-c53b41b1d308 req-ba64ecc2-41ef-4304-8f9f-86313a22c4ee service nova] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-9b3f8b2c-181b-46a7-9a64-c53b41b1d308 req-ba64ecc2-41ef-4304-8f9f-86313a22c4ee service nova] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:18:47 user nova-compute[75260]: DEBUG nova.compute.manager [req-9b3f8b2c-181b-46a7-9a64-c53b41b1d308 req-ba64ecc2-41ef-4304-8f9f-86313a22c4ee service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] No waiting events found dispatching network-vif-plugged-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:18:47 user nova-compute[75260]: WARNING nova.compute.manager [req-9b3f8b2c-181b-46a7-9a64-c53b41b1d308 req-ba64ecc2-41ef-4304-8f9f-86313a22c4ee service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received unexpected event network-vif-plugged-41fb055c-ebba-42f9-afb7-a66d87a38bee for instance with vm_state building and task_state spawning.
Nov 27 05:18:47 user nova-compute[75260]: INFO nova.compute.manager [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Took 11.89 seconds to build instance.
Nov 27 05:18:47 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-899f195d-7988-4881-bdf5-78247c86a8d9 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.018s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:18:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:18:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:02 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:19:07 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:19:11 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:19:11 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:19:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:19:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:19:12 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:19:12 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating instance_info_cache with network_info: [{"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:19:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-ae105a4c-292a-4e8f-8ba3-f8a049f36c18" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:19:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:19:12 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:19:12 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:19:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:15 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:19:16 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:19:16 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:19:16 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:19:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:19:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:19:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:19:16 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75260) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:19:17 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:19:17 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:19:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8738MB free_disk=25.13955307006836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7f5b79fb-c49b-462f-aba3-f83cbe27325e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance ae105a4c-292a-4e8f-8ba3-f8a049f36c18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance a4ad6001-a83d-425f-b689-ee4c8af13be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:19:17 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:19:18 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:19:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:19:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:21 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:19:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:19:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:19:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:19:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:19:23 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:19:23 user nova-compute[75260]: INFO nova.compute.manager [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Terminating instance
Nov 27 05:19:23 user nova-compute[75260]: DEBUG nova.compute.manager [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:19:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-1c7e4fe1-c1f1-484a-9e19-0ab3fb2a5ac2 req-fb91ee3d-053a-4cc5-8d7b-3d36ad558512 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-vif-unplugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1c7e4fe1-c1f1-484a-9e19-0ab3fb2a5ac2 req-fb91ee3d-053a-4cc5-8d7b-3d36ad558512 service nova] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1c7e4fe1-c1f1-484a-9e19-0ab3fb2a5ac2 req-fb91ee3d-053a-4cc5-8d7b-3d36ad558512 service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-1c7e4fe1-c1f1-484a-9e19-0ab3fb2a5ac2 req-fb91ee3d-053a-4cc5-8d7b-3d36ad558512 service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-1c7e4fe1-c1f1-484a-9e19-0ab3fb2a5ac2 req-fb91ee3d-053a-4cc5-8d7b-3d36ad558512 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] No waiting events found dispatching network-vif-unplugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG nova.compute.manager [req-1c7e4fe1-c1f1-484a-9e19-0ab3fb2a5ac2 req-fb91ee3d-053a-4cc5-8d7b-3d36ad558512 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-vif-unplugged-a5a5a85b-a565-4da7-b1bd-b310950edafd for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:24 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Instance destroyed successfully.
Nov 27 05:19:24 user nova-compute[75260]: DEBUG nova.objects.instance [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lazy-loading 'resources' on Instance uuid ae105a4c-292a-4e8f-8ba3-f8a049f36c18 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T05:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-470052070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-470052070',id=49,image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ElAOVom6TMKzYKJcPtfXG6rzQb1nQgeQGu0a6CHhNkbpKQRYE6OJ+pH7SSU1yBVxWgP22smTKQeApkW2XgvVE6023uIyFrbhnBD2auqrXIZvuqMIg6eL7CxuHMp1CcQ==',key_name='tempest-keypair-422796876',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1ba48818d9d412da1471e0f56125dec',ramdisk_id='',reservation_id='r-9q07jitg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a58facc7-83af-4098-886e-ccf8b18b0095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1008190038',owner_user_name='tempest-AttachVolumeShelveTestJSON-1008190038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:17:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bfa8522667f4592bc4bfb0712b6b1f7',uuid=ae105a4c-292a-4e8f-8ba3-f8a049f36c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converting VIF {"id": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "address": "fa:16:3e:e1:83:da", "network": {"id": "65df6e90-75f7-4684-abdf-43b19f6cbadb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-893788563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ba48818d9d412da1471e0f56125dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a5a85b-a5", "ovs_interfaceid": "a5a5a85b-a565-4da7-b1bd-b310950edafd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG os_vif [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5a5a85b-a5, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6203981-65ae-45c9-aa69-231d58c6b47f) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:24 user nova-compute[75260]: INFO os_vif [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:83:da,bridge_name='br-int',has_traffic_filtering=True,id=a5a5a85b-a565-4da7-b1bd-b310950edafd,network=Network(65df6e90-75f7-4684-abdf-43b19f6cbadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a5a85b-a5')
Nov 27 05:19:24 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Deleting instance files /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18_del
Nov 27 05:19:24 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Deletion of /opt/stack/data/nova/instances/ae105a4c-292a-4e8f-8ba3-f8a049f36c18_del complete
Nov 27 05:19:24 user nova-compute[75260]: INFO nova.compute.manager [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 27 05:19:24 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:19:24 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:19:25 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:19:25 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Took 0.75 seconds to deallocate network for instance.
Nov 27 05:19:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-1126a7d0-be3c-419d-8ce0-771fad78c720 req-78b1a3ff-9f2d-472a-a9a3-59d8f1aacda3 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-vif-deleted-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:19:25 user nova-compute[75260]: INFO nova.compute.manager [req-1126a7d0-be3c-419d-8ce0-771fad78c720 req-78b1a3ff-9f2d-472a-a9a3-59d8f1aacda3 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Neutron deleted interface a5a5a85b-a565-4da7-b1bd-b310950edafd; detaching it from the instance and deleting it from the info cache
Nov 27 05:19:25 user nova-compute[75260]: DEBUG nova.network.neutron [req-1126a7d0-be3c-419d-8ce0-771fad78c720 req-78b1a3ff-9f2d-472a-a9a3-59d8f1aacda3 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:19:25 user nova-compute[75260]: DEBUG nova.compute.manager [req-1126a7d0-be3c-419d-8ce0-771fad78c720 req-78b1a3ff-9f2d-472a-a9a3-59d8f1aacda3 service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Detach interface failed, port_id=a5a5a85b-a565-4da7-b1bd-b310950edafd, reason: Instance ae105a4c-292a-4e8f-8ba3-f8a049f36c18 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 05:19:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:19:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:19:25 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:19:25 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:19:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:19:25 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Deleted allocations for instance ae105a4c-292a-4e8f-8ba3-f8a049f36c18
Nov 27 05:19:25 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:19:25 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-30ae2f28-dbc1-4e8e-bb3c-886efd84e60a tempest-AttachVolumeShelveTestJSON-1008190038 tempest-AttachVolumeShelveTestJSON-1008190038-project-member] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.141s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:19:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-a059f0c8-5829-44cd-968d-08c65cfc5d8f req-5ea4b6d6-c5ca-496e-865c-de7480c54f3f service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:19:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a059f0c8-5829-44cd-968d-08c65cfc5d8f req-5ea4b6d6-c5ca-496e-865c-de7480c54f3f service nova] Acquiring lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:19:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a059f0c8-5829-44cd-968d-08c65cfc5d8f req-5ea4b6d6-c5ca-496e-865c-de7480c54f3f service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:19:26 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-a059f0c8-5829-44cd-968d-08c65cfc5d8f req-5ea4b6d6-c5ca-496e-865c-de7480c54f3f service nova] Lock "ae105a4c-292a-4e8f-8ba3-f8a049f36c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:19:26 user nova-compute[75260]: DEBUG nova.compute.manager [req-a059f0c8-5829-44cd-968d-08c65cfc5d8f req-5ea4b6d6-c5ca-496e-865c-de7480c54f3f service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] No waiting events found dispatching network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:19:26 user nova-compute[75260]: WARNING nova.compute.manager [req-a059f0c8-5829-44cd-968d-08c65cfc5d8f req-5ea4b6d6-c5ca-496e-865c-de7480c54f3f service nova] [instance: ae105a4c-292a-4e8f-8ba3-f8a049f36c18] Received unexpected event network-vif-plugged-a5a5a85b-a565-4da7-b1bd-b310950edafd for instance with vm_state deleted and task_state None.
Nov 27 05:19:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:19:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:19:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:19:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:19:34 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:39 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:19:44 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:19:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:19:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:19:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:19:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:19:49 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:54 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:19:59 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:04 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:20:04 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:08 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:09 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:10 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:12 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:20:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 05:20:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:20:12 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquired lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:20:12 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Forcefully refreshing network info cache for instance {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 05:20:12 user nova-compute[75260]: DEBUG nova.objects.instance [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lazy-loading 'info_cache' on Instance uuid 7f5b79fb-c49b-462f-aba3-f83cbe27325e {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:20:13 user nova-compute[75260]: DEBUG nova.network.neutron [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updating instance_info_cache with network_info: [{"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:20:13 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Releasing lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:20:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updated the network info_cache for instance {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 05:20:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:14 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:15 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:15 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:16 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:20:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:20:16 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:20:16 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:20:17 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:20:17 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=25.166667938232422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7f5b79fb-c49b-462f-aba3-f83cbe27325e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance a4ad6001-a83d-425f-b689-ee4c8af13be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing inventories for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating ProviderTree inventory for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Updating inventory in ProviderTree for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing aggregate associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, aggregates: None {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Refreshing trait associations for resource provider f7a986a0-eb41-409b-bde9-ec0b97496a7b, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB {{(pid=75260) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:20:17 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:20:19 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:20:19 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:19 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:20:20 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:20:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:20:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:20:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:20:24 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-e2ca5001-d952-4434-864c-02c418aa1120 req-4249844b-d8da-4fd5-af9b-13777a9fa827 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received event network-changed-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:20:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-e2ca5001-d952-4434-864c-02c418aa1120 req-4249844b-d8da-4fd5-af9b-13777a9fa827 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Refreshing instance network info cache due to event network-changed-41fb055c-ebba-42f9-afb7-a66d87a38bee. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:20:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e2ca5001-d952-4434-864c-02c418aa1120 req-4249844b-d8da-4fd5-af9b-13777a9fa827 service nova] Acquiring lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:20:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e2ca5001-d952-4434-864c-02c418aa1120 req-4249844b-d8da-4fd5-af9b-13777a9fa827 service nova] Acquired lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:20:27 user nova-compute[75260]: DEBUG nova.network.neutron [req-e2ca5001-d952-4434-864c-02c418aa1120 req-4249844b-d8da-4fd5-af9b-13777a9fa827 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Refreshing network info cache for port 41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:20:28 user nova-compute[75260]: DEBUG nova.network.neutron [req-e2ca5001-d952-4434-864c-02c418aa1120 req-4249844b-d8da-4fd5-af9b-13777a9fa827 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Updated VIF entry in instance network info cache for port 41fb055c-ebba-42f9-afb7-a66d87a38bee. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:20:28 user nova-compute[75260]: DEBUG nova.network.neutron [req-e2ca5001-d952-4434-864c-02c418aa1120 req-4249844b-d8da-4fd5-af9b-13777a9fa827 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Updating instance_info_cache with network_info: [{"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:20:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-e2ca5001-d952-4434-864c-02c418aa1120 req-4249844b-d8da-4fd5-af9b-13777a9fa827 service nova] Releasing lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-c7d895e0-b8f4-4b17-97a0-ae552a0b56ad req-2a4db01e-3da6-42b0-8fe0-304e533e9402 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received event network-changed-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-c7d895e0-b8f4-4b17-97a0-ae552a0b56ad req-2a4db01e-3da6-42b0-8fe0-304e533e9402 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Refreshing instance network info cache due to event network-changed-41fb055c-ebba-42f9-afb7-a66d87a38bee. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c7d895e0-b8f4-4b17-97a0-ae552a0b56ad req-2a4db01e-3da6-42b0-8fe0-304e533e9402 service nova] Acquiring lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c7d895e0-b8f4-4b17-97a0-ae552a0b56ad req-2a4db01e-3da6-42b0-8fe0-304e533e9402 service nova] Acquired lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG nova.network.neutron [req-c7d895e0-b8f4-4b17-97a0-ae552a0b56ad req-2a4db01e-3da6-42b0-8fe0-304e533e9402 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Refreshing network info cache for port 41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "a4ad6001-a83d-425f-b689-ee4c8af13be3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:29 user nova-compute[75260]: INFO nova.compute.manager [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Terminating instance
Nov 27 05:20:29 user nova-compute[75260]: DEBUG nova.compute.manager [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG nova.network.neutron [req-c7d895e0-b8f4-4b17-97a0-ae552a0b56ad req-2a4db01e-3da6-42b0-8fe0-304e533e9402 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Updated VIF entry in instance network info cache for port 41fb055c-ebba-42f9-afb7-a66d87a38bee. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG nova.network.neutron [req-c7d895e0-b8f4-4b17-97a0-ae552a0b56ad req-2a4db01e-3da6-42b0-8fe0-304e533e9402 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Updating instance_info_cache with network_info: [{"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-c7d895e0-b8f4-4b17-97a0-ae552a0b56ad req-2a4db01e-3da6-42b0-8fe0-304e533e9402 service nova] Releasing lock "refresh_cache-a4ad6001-a83d-425f-b689-ee4c8af13be3" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:20:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Instance destroyed successfully.
Nov 27 05:20:30 user nova-compute[75260]: DEBUG nova.objects.instance [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'resources' on Instance uuid a4ad6001-a83d-425f-b689-ee4c8af13be3 {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082745135',display_name='tempest-TestVolumeBootPattern-server-2082745135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082745135',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxjZgWBkC0vDIW+qP/oRdSAxQoY7m7bOeoA2c9MMZIbWYe3A6sjz1pgcrW4HTR4ErkM9d3sc/JlyOUNttSfKV4iyZ0ArGo73rhxgqnOA8qA96OB7kCqJ04RO/xhIBEqBg==',key_name='tempest-TestVolumeBootPattern-141657573',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-fmljlii4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:18:48Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=a4ad6001-a83d-425f-b689-ee4c8af13be3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "address": "fa:16:3e:83:2a:c9", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fb055c-eb", "ovs_interfaceid": "41fb055c-ebba-42f9-afb7-a66d87a38bee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:2a:c9,bridge_name='br-int',has_traffic_filtering=True,id=41fb055c-ebba-42f9-afb7-a66d87a38bee,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fb055c-eb') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_vif [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:2a:c9,bridge_name='br-int',has_traffic_filtering=True,id=41fb055c-ebba-42f9-afb7-a66d87a38bee,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fb055c-eb') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41fb055c-eb, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67ec0417-1a40-41df-891e-168070f69e1a) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:20:30 user nova-compute[75260]: INFO os_vif [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:2a:c9,bridge_name='br-int',has_traffic_filtering=True,id=41fb055c-ebba-42f9-afb7-a66d87a38bee,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fb055c-eb')
Nov 27 05:20:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMOhUkNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:20:30 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ecd0c2-4aff-4672-86a2-3cfdc7b16dec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:20:30 user nova-compute[75260]: No targets found.
Nov 27 05:20:30 user nova-compute[75260]: iSNS:
Nov 27 05:20:30 user nova-compute[75260]: No targets found.
Nov 27 05:20:30 user nova-compute[75260]: STATIC:
Nov 27 05:20:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293
Nov 27 05:20:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:20:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:20:30 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788
Nov 27 05:20:30 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:20:30 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:20:30 user nova-compute[75260]: FIRMWARE:
Nov 27 05:20:30 user nova-compute[75260]: No targets found.
Nov 27 05:20:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:20:30 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:20:30 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ec2b82-a09d-44fd-9801-e2ac972986d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbef9cf-87b5-4f8a-960f-6b2a806cf262]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:20:30 user nova-compute[75260]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 (non-flash)
Nov 27 05:20:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:20:30 user nova-compute[75260]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 (non-flash)
Nov 27 05:20:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb347516c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293'): ({'sdc'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Removing single pathed devices sdc {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[81303c6d-118b-4485-be53-1c95a690bbf1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af27d5-99bf-45b9-a5ed-34631454fed9]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flushing IO for device /dev/sdc {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2796d74-a91e-43ad-b704-518d129780ca]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d46dc19-993d-4fb4-a2c7-3b4f8fc412c6]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] SCSI volumes sdc have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b2f2795b', '/dev/disk/by-id/scsi-1SCST_BIOb2f2795b-2085bb9d4c0b2c2c', '/dev/disk/by-id/scsi-23230383562623964') {{(pid=85819) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e2bd84-29db-4e6b-b820-4077568ff1e7]: (4, None) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98fd3b5-3f02-47af-bf1c-e67a60d0914e]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a4feb9-6cff-4be6-bab7-d1cc238f67c5]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293, portal: 172.16.0.220,3260]
Nov 27 05:20:30 user nova-compute[75260]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293, portal: 172.16.0.220,3260] successful.
Nov 27 05:20:30 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c94993-71ab-40a2-be34-a0a5d56b0293 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db28e78-2091-4eff-93bd-715247320ce6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== disconnect_volume: return (311ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:20:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Deleting instance files /opt/stack/data/nova/instances/a4ad6001-a83d-425f-b689-ee4c8af13be3_del
Nov 27 05:20:30 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Deletion of /opt/stack/data/nova/instances/a4ad6001-a83d-425f-b689-ee4c8af13be3_del complete
Nov 27 05:20:30 user nova-compute[75260]: INFO nova.compute.manager [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 27 05:20:30 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:20:30 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:20:31 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:20:31 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Took 0.44 seconds to deallocate network for instance.
Nov 27 05:20:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-99fd1ef6-d274-4adb-9033-144bb8bc8f8b req-ecc36f64-45ad-455f-84d2-34586dd12e40 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received event network-vif-deleted-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:20:31 user nova-compute[75260]: INFO nova.compute.manager [req-99fd1ef6-d274-4adb-9033-144bb8bc8f8b req-ecc36f64-45ad-455f-84d2-34586dd12e40 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Neutron deleted interface 41fb055c-ebba-42f9-afb7-a66d87a38bee; detaching it from the instance and deleting it from the info cache
Nov 27 05:20:31 user nova-compute[75260]: DEBUG nova.network.neutron [req-99fd1ef6-d274-4adb-9033-144bb8bc8f8b req-ecc36f64-45ad-455f-84d2-34586dd12e40 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:20:31 user nova-compute[75260]: DEBUG nova.compute.manager [req-99fd1ef6-d274-4adb-9033-144bb8bc8f8b req-ecc36f64-45ad-455f-84d2-34586dd12e40 service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Detach interface failed, port_id=41fb055c-ebba-42f9-afb7-a66d87a38bee, reason: Instance a4ad6001-a83d-425f-b689-ee4c8af13be3 could not be found. {{(pid=75260) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received event network-vif-unplugged-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] Acquiring lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] No waiting events found dispatching network-vif-unplugged-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received event network-vif-unplugged-41fb055c-ebba-42f9-afb7-a66d87a38bee for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received event network-vif-plugged-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] Acquiring lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG nova.compute.manager [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] No waiting events found dispatching network-vif-plugged-41fb055c-ebba-42f9-afb7-a66d87a38bee {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:20:32 user nova-compute[75260]: WARNING nova.compute.manager [req-5d400783-ca88-444e-aff1-7443bfcf7a87 req-f0ec4044-7032-45b3-8dd4-c5e6dd9a3b4f service nova] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Received unexpected event network-vif-plugged-41fb055c-ebba-42f9-afb7-a66d87a38bee for instance with vm_state active and task_state deleting.
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75260) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 05:20:32 user nova-compute[75260]: INFO nova.compute.manager [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: a4ad6001-a83d-425f-b689-ee4c8af13be3] Took 0.75 seconds to detach 1 volumes for instance.
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:20:32 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Deleted allocations for instance a4ad6001-a83d-425f-b689-ee4c8af13be3
Nov 27 05:20:32 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-45ced7c6-f4d1-404b-9df1-8cd714400e73 tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "a4ad6001-a83d-425f-b689-ee4c8af13be3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.725s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:20:32 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:34 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:20:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Cleaning up deleted instances {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 05:20:34 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] There are 0 instances to clean {{(pid=75260) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 05:20:35 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:40 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:20:45 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:20:50 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:20:55 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:21:00 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:21:05 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:06 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:21:10 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:21:12 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:21:12 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:21:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:21:12 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 05:21:15 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:15 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:21:15 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:21:17 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:21:18 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:21:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:21:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:21:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:21:18 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:21:19 user nova-compute[75260]: DEBUG nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75260) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 05:21:19 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:21:19 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:21:19 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=25.164134979248047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:21:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:21:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:21:19 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Instance 7f5b79fb-c49b-462f-aba3-f83cbe27325e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75260) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 05:21:19 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:21:19 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:21:19 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:21:19 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:21:19 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:21:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:21:20 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:21:20 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:21:20 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:21:20 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:21:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-700495ea-3673-48bb-aa7a-25fe3a93bc37 req-25c53dc3-9a7f-43a7-916d-c6ea3d68d9a6 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received event network-changed-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-700495ea-3673-48bb-aa7a-25fe3a93bc37 req-25c53dc3-9a7f-43a7-916d-c6ea3d68d9a6 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Refreshing instance network info cache due to event network-changed-6e756b4b-f7f1-4b87-a306-15401e182fe4. {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-700495ea-3673-48bb-aa7a-25fe3a93bc37 req-25c53dc3-9a7f-43a7-916d-c6ea3d68d9a6 service nova] Acquiring lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-700495ea-3673-48bb-aa7a-25fe3a93bc37 req-25c53dc3-9a7f-43a7-916d-c6ea3d68d9a6 service nova] Acquired lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG nova.network.neutron [req-700495ea-3673-48bb-aa7a-25fe3a93bc37 req-25c53dc3-9a7f-43a7-916d-c6ea3d68d9a6 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Refreshing network info cache for port 6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:21:27 user nova-compute[75260]: INFO nova.compute.manager [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Terminating instance
Nov 27 05:21:27 user nova-compute[75260]: DEBUG nova.compute.manager [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Start destroying the instance on the hypervisor. {{(pid=75260) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-71a0d51b-1435-4cb1-8edc-2af7b2d7ee07 req-11676ccf-46c2-4b4c-b616-8b4f0053758f service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received event network-vif-unplugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-71a0d51b-1435-4cb1-8edc-2af7b2d7ee07 req-11676ccf-46c2-4b4c-b616-8b4f0053758f service nova] Acquiring lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-71a0d51b-1435-4cb1-8edc-2af7b2d7ee07 req-11676ccf-46c2-4b4c-b616-8b4f0053758f service nova] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-71a0d51b-1435-4cb1-8edc-2af7b2d7ee07 req-11676ccf-46c2-4b4c-b616-8b4f0053758f service nova] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-71a0d51b-1435-4cb1-8edc-2af7b2d7ee07 req-11676ccf-46c2-4b4c-b616-8b4f0053758f service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] No waiting events found dispatching network-vif-unplugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:21:27 user nova-compute[75260]: DEBUG nova.compute.manager [req-71a0d51b-1435-4cb1-8edc-2af7b2d7ee07 req-11676ccf-46c2-4b4c-b616-8b4f0053758f service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received event network-vif-unplugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 for instance with task_state deleting. {{(pid=75260) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 05:21:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [-] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Instance destroyed successfully.
Nov 27 05:21:28 user nova-compute[75260]: DEBUG nova.objects.instance [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lazy-loading 'resources' on Instance uuid 7f5b79fb-c49b-462f-aba3-f83cbe27325e {{(pid=75260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.vif [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T05:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-450263254',display_name='tempest-TestVolumeBootPattern-server-450263254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-450263254',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxjZgWBkC0vDIW+qP/oRdSAxQoY7m7bOeoA2c9MMZIbWYe3A6sjz1pgcrW4HTR4ErkM9d3sc/JlyOUNttSfKV4iyZ0ArGo73rhxgqnOA8qA96OB7kCqJ04RO/xhIBEqBg==',key_name='tempest-TestVolumeBootPattern-141657573',keypairs=<?>,launch_index=0,launched_at=2023-11-27T05:16:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b302e83cda4b6bacc8e613016c8189',ramdisk_id='',reservation_id='r-pzjzlvwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1806325901',owner_user_name='tempest-TestVolumeBootPattern-1806325901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T05:16:47Z,user_data=None,user_id='5bbd9c9317ac4d34ad23932bb35bcc87',uuid=7f5b79fb-c49b-462f-aba3-f83cbe27325e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converting VIF {"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG nova.network.os_vif_util [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:d3:f5,bridge_name='br-int',has_traffic_filtering=True,id=6e756b4b-f7f1-4b87-a306-15401e182fe4,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e756b4b-f7') {{(pid=75260) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_vif [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:d3:f5,bridge_name='br-int',has_traffic_filtering=True,id=6e756b4b-f7f1-4b87-a306-15401e182fe4,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e756b4b-f7') {{(pid=75260) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e756b4b-f7, bridge=br-int, if_exists=True) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43f9f1d2-0c07-47d7-b20e-26c21cd4de0b) {{(pid=75260) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:28 user nova-compute[75260]: INFO os_vif [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:d3:f5,bridge_name='br-int',has_traffic_filtering=True,id=6e756b4b-f7f1-4b87-a306-15401e182fe4,network=Network(54308572-7521-43ea-9f17-72305f89a020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e756b4b-f7')
Nov 27 05:21:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] calling os-brick to detach iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb6c334cd0>, {'target_iqn': 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLjDAogv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 05:21:28 user nova-compute[75260]: WARNING os_brick.initiator.connectors.base [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[2723021e-79b6-4cd7-9457-40760bd1aeeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 05:21:28 user nova-compute[75260]: No targets found.
Nov 27 05:21:28 user nova-compute[75260]: iSNS:
Nov 27 05:21:28 user nova-compute[75260]: No targets found.
Nov 27 05:21:28 user nova-compute[75260]: STATIC:
Nov 27 05:21:28 user nova-compute[75260]: Target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788
Nov 27 05:21:28 user nova-compute[75260]:         Portal: 172.16.0.220:3260,-1
Nov 27 05:21:28 user nova-compute[75260]:                 Iface Name: default
Nov 27 05:21:28 user nova-compute[75260]: FIRMWARE:
Nov 27 05:21:28 user nova-compute[75260]: No targets found.
Nov 27 05:21:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 05:21:28 user nova-compute[75260]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 05:21:28 user nova-compute[75260]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75260) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788', 0)] {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG nova.network.neutron [req-700495ea-3673-48bb-aa7a-25fe3a93bc37 req-25c53dc3-9a7f-43a7-916d-c6ea3d68d9a6 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updated VIF entry in instance network info cache for port 6e756b4b-f7f1-4b87-a306-15401e182fe4. {{(pid=75260) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG nova.network.neutron [req-700495ea-3673-48bb-aa7a-25fe3a93bc37 req-25c53dc3-9a7f-43a7-916d-c6ea3d68d9a6 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updating instance_info_cache with network_info: [{"id": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "address": "fa:16:3e:05:d3:f5", "network": {"id": "54308572-7521-43ea-9f17-72305f89a020", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1257796459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b302e83cda4b6bacc8e613016c8189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e756b4b-f7", "ovs_interfaceid": "6e756b4b-f7f1-4b87-a306-15401e182fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53f736b-7335-4204-9d93-efacf71afdeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-700495ea-3673-48bb-aa7a-25fe3a93bc37 req-25c53dc3-9a7f-43a7-916d-c6ea3d68d9a6 service nova] Releasing lock "refresh_cache-7f5b79fb-c49b-462f-aba3-f83cbe27325e" {{(pid=75260) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfbc201-76d0-4529-8f38-6b68879b1d41]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:21:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 (non-flash)
Nov 27 05:21:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb6c108280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788'): ({'sdb'}, set())}) {{(pid=75260) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Removing single pathed devices sdb {{(pid=75260) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[92975dcb-da1e-40b0-90c4-ba4e024086e8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d7253d-29dc-4553-a3f8-661dd53c4366]: (4, ('ok\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Flushing IO for device /dev/sdb {{(pid=75260) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0e9789-44ff-48ed-a2db-e840608bdbf6]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75260) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4bd66a-3879-4a1f-8cf5-f20e7b7cc008]: (4, ('1', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.linuxscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] SCSI volumes sdb have been removed. {{(pid=75260) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5a870d19', '/dev/disk/by-id/scsi-23162623163616439', '/dev/disk/by-id/scsi-1SCST_BIO5a870d19-1bb1cad96450faff') {{(pid=85819) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 05:21:28 user nova-compute[75260]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_5a870d19
Nov 27 05:21:28 user nova-compute[75260]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23162623163616439
Nov 27 05:21:28 user nova-compute[75260]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO5a870d19-1bb1cad96450faff
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f51b3d-6f09-462b-9de9-df89240bec3b]: (4, None) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788')] {{(pid=75260) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac261de-031f-4906-a05c-8999cd707fa9]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --logout {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[a868852f-41b9-4c84-b7b7-8b379eae6a22]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260]
Nov 27 05:21:28 user nova-compute[75260]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788, portal: 172.16.0.220,3260] successful.
Nov 27 05:21:28 user nova-compute[75260]:  stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op delete {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdc4fa49-5924-4fd1-9dd7-b41a3aa6e788 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abf2224-de52-4221-937a-247e5f6564c0]: (4, ('', '')) {{(pid=85819) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75260) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.base [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] <== disconnect_volume: return (319ms) None {{(pid=75260) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Disconnected iSCSI Volume {{(pid=75260) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 05:21:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Deleting instance files /opt/stack/data/nova/instances/7f5b79fb-c49b-462f-aba3-f83cbe27325e_del
Nov 27 05:21:28 user nova-compute[75260]: INFO nova.virt.libvirt.driver [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Deletion of /opt/stack/data/nova/instances/7f5b79fb-c49b-462f-aba3-f83cbe27325e_del complete
Nov 27 05:21:28 user nova-compute[75260]: INFO nova.compute.manager [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo.service.loopingcall [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75260) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG nova.compute.manager [-] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Deallocating network for instance {{(pid=75260) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] deallocate_for_instance() {{(pid=75260) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 05:21:28 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:21:29 user nova-compute[75260]: DEBUG nova.network.neutron [-] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Updating instance_info_cache with network_info: [] {{(pid=75260) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 05:21:29 user nova-compute[75260]: INFO nova.compute.manager [-] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Took 0.60 seconds to deallocate network for instance.
Nov 27 05:21:29 user nova-compute[75260]: DEBUG nova.compute.manager [req-26857f21-9293-479f-b064-7d0cf7a3e679 req-b8454e65-3309-4673-b633-ba9d57a3672e service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received event network-vif-deleted-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:21:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-ce8a0d69-6a4e-47f8-b3b4-a215726319cc req-f2346782-2039-4e84-892f-50b976ed6936 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received event network-vif-plugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 05:21:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ce8a0d69-6a4e-47f8-b3b4-a215726319cc req-f2346782-2039-4e84-892f-50b976ed6936 service nova] Acquiring lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:21:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ce8a0d69-6a4e-47f8-b3b4-a215726319cc req-f2346782-2039-4e84-892f-50b976ed6936 service nova] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:21:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [req-ce8a0d69-6a4e-47f8-b3b4-a215726319cc req-f2346782-2039-4e84-892f-50b976ed6936 service nova] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:21:30 user nova-compute[75260]: DEBUG nova.compute.manager [req-ce8a0d69-6a4e-47f8-b3b4-a215726319cc req-f2346782-2039-4e84-892f-50b976ed6936 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] No waiting events found dispatching network-vif-plugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 {{(pid=75260) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 05:21:30 user nova-compute[75260]: WARNING nova.compute.manager [req-ce8a0d69-6a4e-47f8-b3b4-a215726319cc req-f2346782-2039-4e84-892f-50b976ed6936 service nova] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Received unexpected event network-vif-plugged-6e756b4b-f7f1-4b87-a306-15401e182fe4 for instance with vm_state active and task_state deleting.
Nov 27 05:21:30 user nova-compute[75260]: INFO nova.compute.manager [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] [instance: 7f5b79fb-c49b-462f-aba3-f83cbe27325e] Took 0.77 seconds to detach 1 volumes for instance.
Nov 27 05:21:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:21:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:21:30 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:21:30 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:21:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:21:30 user nova-compute[75260]: INFO nova.scheduler.client.report [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Deleted allocations for instance 7f5b79fb-c49b-462f-aba3-f83cbe27325e
Nov 27 05:21:30 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-6f963459-2353-4bb5-83cb-9519b6f0dd0a tempest-TestVolumeBootPattern-1806325901 tempest-TestVolumeBootPattern-1806325901-project-member] Lock "7f5b79fb-c49b-462f-aba3-f83cbe27325e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.948s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:21:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:21:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:21:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:21:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:21:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:21:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:21:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:21:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:21:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:21:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:22:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:22:06 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:22:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:22:12 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:22:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:22:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:22:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:22:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 05:22:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 05:22:15 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:22:16 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:22:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:22:18 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:22:18 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:22:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:22:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:22:18 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:22:18 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:22:19 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:22:19 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:22:19 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=9074MB free_disk=25.15326690673828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:22:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:22:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:22:19 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:22:19 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:22:19 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:22:19 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:22:19 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:22:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:22:22 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:22:22 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:22:22 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:22:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:22:25 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:22:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:22:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:22:29 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:22:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:22:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:22:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:22:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:22:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:22:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:22:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:22:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:22:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:22:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:22:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:23:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:23:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:23:08 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:23:12 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:23:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:23:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:23:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75260) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 05:23:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:23:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75260) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 05:23:13 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:23:13 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:23:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Starting heal instance info cache {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 05:23:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Rebuilding the list of instances to heal {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 05:23:13 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Didn't find any instances for network info cache update. {{(pid=75260) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 05:23:15 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:23:18 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:23:18 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:23:18 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:23:19 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:23:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:23:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:23:19 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:23:19 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75260) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 05:23:20 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:23:20 user nova-compute[75260]: WARNING nova.virt.libvirt.driver [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 05:23:20 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Hypervisor/Node resource view: name=user free_ram=9266MB free_disk=25.145267486572266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75260) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 05:23:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 05:23:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 05:23:20 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 05:23:20 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75260) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 05:23:20 user nova-compute[75260]: DEBUG nova.compute.provider_tree [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed in ProviderTree for provider: f7a986a0-eb41-409b-bde9-ec0b97496a7b {{(pid=75260) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 05:23:20 user nova-compute[75260]: DEBUG nova.scheduler.client.report [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Inventory has not changed for provider f7a986a0-eb41-409b-bde9-ec0b97496a7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75260) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 05:23:20 user nova-compute[75260]: DEBUG nova.compute.resource_tracker [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Compute_service record updated for user:user {{(pid=75260) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 05:23:20 user nova-compute[75260]: DEBUG oslo_concurrency.lockutils [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=75260) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 05:23:23 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:23:23 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:23:23 user nova-compute[75260]: DEBUG nova.compute.manager [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75260) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 05:23:23 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:23:28 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:23:32 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 05:23:33 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:23:38 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:23:43 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:23:48 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:23:53 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:23:58 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:24:03 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 05:24:08 user nova-compute[75260]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75260) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 05:24:09 user nova-compute[75260]: DEBUG oslo_service.periodic_task [None req-3236d2b2-cdc2-423c-9239-0fdf994eda9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75260) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}